[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:57:12 dist-test-slave-tc2s krb5kdc[18722](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:57:12 dist-test-slave-tc2s krb5kdc[18722](info): set up 2 sockets
Aug 12 06:57:12 dist-test-slave-tc2s krb5kdc[18722](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 06:57:13.507892 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.211s user 0.003s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:57:13 dist-test-slave-tc2s krb5kdc[18722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:57:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:57:13.676110 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:37777
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:46711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:37777
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:13.993806 18747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:13.994139 18747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:13.994270 18747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:14.001475 18747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:14.001583 18747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:14.001655 18747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:14.001730 18747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:14.001789 18747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:57:14.011710 18747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:37777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:37777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:14.012966 18747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:14.014324 18747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:14.025668 18761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:14.025743 18758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:14.025718 18752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:14.026723 18747 server_base.cc:1034] running on GCE node
I20260812 06:57:14.027480 18747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:14.028842 18747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:14.030078 18747 hybrid_clock.cc:648] HybridClock initialized: now 1786517834030028 us; error 94 us; skew 500 ppm
I20260812 06:57:14.030421 18747 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:14 dist-test-slave-tc2s krb5kdc[18722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517834, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:14.036289 18747 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:57:14.037678 18747 webserver.cc:460] Webserver started at http://127.18.70.190:39361/ using document root <none> and password file <none>
I20260812 06:57:14.038381 18747 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:14.038491 18747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:14.038779 18747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:14.041774 18747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "d0e3160729ca42948137dedc8f9d08bc"
format_stamp: "Formatted at 2026-08-12 06:57:14 on dist-test-slave-tc2s"
server_key: "390901af6d9f9e1981cbf2845c5d0e57"
server_key_iv: "60e9ec7c654fef21363d54b82a904d7e"
server_key_version: "encryptionkey@0"
I20260812 06:57:14.042555 18747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "d0e3160729ca42948137dedc8f9d08bc"
format_stamp: "Formatted at 2026-08-12 06:57:14 on dist-test-slave-tc2s"
server_key: "390901af6d9f9e1981cbf2845c5d0e57"
server_key_iv: "60e9ec7c654fef21363d54b82a904d7e"
server_key_version: "encryptionkey@0"
I20260812 06:57:14.047552 18747 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 06:57:14.050832 18773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:14.052081 18747 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:14.052232 18747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "d0e3160729ca42948137dedc8f9d08bc"
format_stamp: "Formatted at 2026-08-12 06:57:14 on dist-test-slave-tc2s"
server_key: "390901af6d9f9e1981cbf2845c5d0e57"
server_key_iv: "60e9ec7c654fef21363d54b82a904d7e"
server_key_version: "encryptionkey@0"
I20260812 06:57:14.052400 18747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:14.083371 18747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:14.087276 18747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:14.087534 18747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:14.104447 18747 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:37777
I20260812 06:57:14.104477 18882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:37777 every 8 connection(s)
I20260812 06:57:14.105722 18747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:14.109328 18885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:14.112268 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 18747
I20260812 06:57:14.112548 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:14.114418 18714 external_mini_cluster.cc:1428] Setting key 13232b8547b5b433abe1d8ae7677247d
I20260812 06:57:14.120373 18885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc: Bootstrap starting.
I20260812 06:57:14.123234 18885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:14.124182 18885 log.cc:824] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:14.126747 18885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc: No bootstrap required, opened a new log
I20260812 06:57:14.136155 18885 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0e3160729ca42948137dedc8f9d08bc" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37777 } }
I20260812 06:57:14.136615 18885 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:14.136729 18885 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0e3160729ca42948137dedc8f9d08bc, State: Initialized, Role: FOLLOWER
I20260812 06:57:14.137409 18885 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0e3160729ca42948137dedc8f9d08bc" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37777 } }
I20260812 06:57:14.137679 18885 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:14.137810 18885 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:14.137980 18885 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:14.140218 18885 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0e3160729ca42948137dedc8f9d08bc" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37777 } }
I20260812 06:57:14.140695 18885 leader_election.cc:302] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0e3160729ca42948137dedc8f9d08bc; no voters:
I20260812 06:57:14.141250 18885 leader_election.cc:288] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:14.141395 18892 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [term 1 FOLLOWER]: Leader election won for term 1
Aug 12 06:57:14 dist-test-slave-tc2s krb5kdc[18722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:14.142494 18892 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [term 1 LEADER]: Becoming Leader. State: Replica: d0e3160729ca42948137dedc8f9d08bc, State: Running, Role: LEADER
I20260812 06:57:14.143059 18892 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0e3160729ca42948137dedc8f9d08bc" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37777 } }
I20260812 06:57:14.143337 18885 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:14.146063 18896 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0e3160729ca42948137dedc8f9d08bc. Latest consensus state: current_term: 1 leader_uuid: "d0e3160729ca42948137dedc8f9d08bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0e3160729ca42948137dedc8f9d08bc" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37777 } } }
I20260812 06:57:14.146436 18896 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:14.147011 18894 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0e3160729ca42948137dedc8f9d08bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0e3160729ca42948137dedc8f9d08bc" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37777 } } }
I20260812 06:57:14.147279 18894 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:14.153615 18889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:14.118183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36676 (local address 127.18.70.190:37777)
0812 06:57:14.118919 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:14.118929 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:14.120183 (+ 1254us) server_negotiation.cc:407] Connection header received
0812 06:57:14.129000 (+ 8817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:14.129026 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:14.129485 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:14.129922 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:14.132452 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:14.134531 (+ 2079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:14.136091 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:14.137134 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:14.137312 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:14.143392 (+ 6080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:14.143403 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:14.143420 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:14.143467 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:14.147831 (+ 4364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:14.148936 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:14.148945 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:14.148954 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:14.149176 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:14.149712 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:14.149717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:14.149721 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:14.150468 (+ 747us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:14.150775 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:14.151795 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0812 06:57:14.152234 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":331,"threads_started":1}
I20260812 06:57:14.157612 18901 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:14.161720 18901 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:14.170621 18901 catalog_manager.cc:1347] Generated new cluster ID: 5348415d2258458dab94fa94129b3f2a
I20260812 06:57:14.170743 18901 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:14.210657 18901 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:14.211985 18901 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:14.220423 18901 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0e3160729ca42948137dedc8f9d08bc: Generated new TSK 0
I20260812 06:57:14.221169 18901 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:57:14.269239 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:37777
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:46711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:14.591420 18928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:14.591703 18928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:14.591815 18928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:14.599123 18928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:14.599227 18928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:14.599340 18928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:57:14.609032 18928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:37777
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:14.610287 18928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:14.611559 18928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:14.623979 18943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:14.624020 18946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:14.624045 18949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:14.624840 18928 server_base.cc:1034] running on GCE node
I20260812 06:57:14.625486 18928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:14.626425 18928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:14.627655 18928 hybrid_clock.cc:648] HybridClock initialized: now 1786517834627600 us; error 46 us; skew 500 ppm
I20260812 06:57:14.627982 18928 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:14 dist-test-slave-tc2s krb5kdc[18722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517834, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:14.631143 18928 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:57:14.632531 18928 webserver.cc:460] Webserver started at http://127.18.70.129:44125/ using document root <none> and password file <none>
I20260812 06:57:14.633200 18928 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:14.633320 18928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:14.633622 18928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:14.636606 18928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "aa98014e5f57461c9fd98963635b9dbb"
format_stamp: "Formatted at 2026-08-12 06:57:14 on dist-test-slave-tc2s"
server_key: "6e7aced7f45f95f61c7d09d08a099200"
server_key_iv: "da441dac3e6e2146aed052e4f2e4fc64"
server_key_version: "encryptionkey@0"
I20260812 06:57:14.637358 18928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "aa98014e5f57461c9fd98963635b9dbb"
format_stamp: "Formatted at 2026-08-12 06:57:14 on dist-test-slave-tc2s"
server_key: "6e7aced7f45f95f61c7d09d08a099200"
server_key_iv: "da441dac3e6e2146aed052e4f2e4fc64"
server_key_version: "encryptionkey@0"
I20260812 06:57:14.642526 18928 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 06:57:14.646071 18968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:14.647336 18928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 06:57:14.647501 18928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "aa98014e5f57461c9fd98963635b9dbb"
format_stamp: "Formatted at 2026-08-12 06:57:14 on dist-test-slave-tc2s"
server_key: "6e7aced7f45f95f61c7d09d08a099200"
server_key_iv: "da441dac3e6e2146aed052e4f2e4fc64"
server_key_version: "encryptionkey@0"
I20260812 06:57:14.647686 18928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:14.672662 18928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:14.676789 18928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:14.677073 18928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:14.678086 18928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:14.679401 18928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:14.679486 18928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:14.679608 18928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:14.679665 18928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:14.710127 18928 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:32875
I20260812 06:57:14.710192 19171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:32875 every 8 connection(s)
I20260812 06:57:14.711375 18928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:57:14.714730 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 18928
I20260812 06:57:14.714999 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:57:14.715808 18714 external_mini_cluster.cc:1428] Setting key 4450e4fdde75bfdc365723faa023b82a
Aug 12 06:57:14 dist-test-slave-tc2s krb5kdc[18722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517834, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:14.730865 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:14.714003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:47333 (local address 127.18.70.190:37777)
0812 06:57:14.714438 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:14.714442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:14.715495 (+ 1053us) server_negotiation.cc:407] Connection header received
0812 06:57:14.717368 (+ 1873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:14.717374 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:14.717462 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:14.717554 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:14.719070 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:14.719818 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:14.721483 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:14.721879 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:14.722018 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:14.725456 (+ 3438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:14.725461 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:14.725464 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:14.725496 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:14.727787 (+ 2291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:14.728484 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:14.728488 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:14.728491 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:14.728633 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:14.729177 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:14.729180 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:14.729182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:14.729456 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:14.729564 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:14.730442 (+ 878us) server_negotiation.cc:299] Negotiation successful
0812 06:57:14.730617 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":217,"threads_started":1}
I20260812 06:57:14.732429 19176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:14.714532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:37777 (local address 127.18.70.129:47333)
0812 06:57:14.715340 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:14.715377 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:14.717102 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:14.717800 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:14.717808 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:14.718349 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:14.718894 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:14.718911 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:14.719988 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:14.719992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:14.721336 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:14.721350 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:14.722112 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:14.722120 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:14.722329 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:14.722978 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:14.723002 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:14.725236 (+ 2234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:14.727920 (+ 2684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:14.727929 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:14.727944 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:14.728363 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:14.728777 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:14.728782 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:14.728786 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:14.729054 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:14.729593 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:14.729601 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:14.730065 (+ 464us) client_negotiation.cc:769] Sending connection context
0812 06:57:14.730395 (+ 330us) client_negotiation.cc:240] Negotiation successful
0812 06:57:14.730933 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":350,"threads_started":1}
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
I20260812 06:57:14.733952 19172 heartbeater.cc:347] Connected to a master server at 127.18.70.190:37777
I20260812 06:57:14.734278 19172 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:14.734967 19172 heartbeater.cc:511] Master 127.18.70.190:37777 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
I20260812 06:57:14.737085 18816 ts_manager.cc:194] Registered new tserver with Master: aa98014e5f57461c9fd98963635b9dbb (127.18.70.129:32875)
I20260812 06:57:14.738559 18816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:47333
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 06:57:14.755304 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:37777
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:46711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:15.075711 19181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:15.075982 19181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:15.076116 19181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:15.083160 19181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:15.083257 19181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:15.083410 19181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:57:15.092995 19181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:37777
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:15.094249 19181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:15.095572 19181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:15.108136 19192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:15.108314 19197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:15.108620 19194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:15.109270 19181 server_base.cc:1034] running on GCE node
I20260812 06:57:15.109867 19181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:15.110844 19181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:15.112057 19181 hybrid_clock.cc:648] HybridClock initialized: now 1786517835112014 us; error 38 us; skew 500 ppm
I20260812 06:57:15.112344 19181 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:15 dist-test-slave-tc2s krb5kdc[18722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517835, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:15.115424 19181 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:57:15.116884 19181 webserver.cc:460] Webserver started at http://127.18.70.130:41071/ using document root <none> and password file <none>
I20260812 06:57:15.117523 19181 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:15.117630 19181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:15.117962 19181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:15.120784 19181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "fe513c1e9d5d420e84f39a4349e3d09e"
format_stamp: "Formatted at 2026-08-12 06:57:15 on dist-test-slave-tc2s"
server_key: "08c6fc7ef6ac5b01e884482a98130df7"
server_key_iv: "42e056868eac17d217c2f14903f2a8a4"
server_key_version: "encryptionkey@0"
I20260812 06:57:15.121520 19181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "fe513c1e9d5d420e84f39a4349e3d09e"
format_stamp: "Formatted at 2026-08-12 06:57:15 on dist-test-slave-tc2s"
server_key: "08c6fc7ef6ac5b01e884482a98130df7"
server_key_iv: "42e056868eac17d217c2f14903f2a8a4"
server_key_version: "encryptionkey@0"
I20260812 06:57:15.126330 19181 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.001s
I20260812 06:57:15.129535 19212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:15.130816 19181 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:15.130959 19181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "fe513c1e9d5d420e84f39a4349e3d09e"
format_stamp: "Formatted at 2026-08-12 06:57:15 on dist-test-slave-tc2s"
server_key: "08c6fc7ef6ac5b01e884482a98130df7"
server_key_iv: "42e056868eac17d217c2f14903f2a8a4"
server_key_version: "encryptionkey@0"
I20260812 06:57:15.131120 19181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:15.147241 19181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:15.151058 19181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:15.151286 19181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:15.152236 19181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:15.153541 19181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:15.153611 19181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:15.153704 19181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:15.153746 19181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:15.182962 19181 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:37403
I20260812 06:57:15.183028 19425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:37403 every 8 connection(s)
I20260812 06:57:15.184195 19181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:57:15.189396 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 19181
I20260812 06:57:15.189574 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:57:15.190128 18714 external_mini_cluster.cc:1428] Setting key 22ecd654dc86712bc2ae6200b23927dd
Aug 12 06:57:15 dist-test-slave-tc2s krb5kdc[18722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517835, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:15.204264 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:15.186716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:57405 (local address 127.18.70.190:37777)
0812 06:57:15.186921 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:15.186927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:15.188085 (+ 1158us) server_negotiation.cc:407] Connection header received
0812 06:57:15.189879 (+ 1794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:15.189886 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:15.189992 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:15.190100 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:15.191647 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.192592 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.194224 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.194809 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.194941 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:15.198628 (+ 3687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:15.198633 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:15.198636 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:15.198670 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:15.201173 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.201874 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.201878 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.201881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.202040 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.202468 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.202473 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.202476 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.202736 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:15.202891 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:15.203687 (+ 796us) server_negotiation.cc:299] Negotiation successful
0812 06:57:15.203940 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 06:57:15.205215 19435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:15.187229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:37777 (local address 127.18.70.130:57405)
0812 06:57:15.187929 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:15.187973 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:15.189610 (+ 1637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:15.190307 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:15.190315 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:15.190808 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:15.191474 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:15.191499 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.192755 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.192758 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:15.194077 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:15.194090 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.195036 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.195042 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:15.195292 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:15.195991 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:15.196016 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:15.198411 (+ 2395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:15.201315 (+ 2904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:15.201325 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:15.201342 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:15.201756 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:15.202147 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:15.202152 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:15.202157 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:15.202360 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:15.203002 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:15.203009 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:15.203335 (+ 326us) client_negotiation.cc:769] Sending connection context
0812 06:57:15.203582 (+ 247us) client_negotiation.cc:240] Negotiation successful
0812 06:57:15.204113 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":264,"threads_started":1}
I20260812 06:57:15.206645 19426 heartbeater.cc:347] Connected to a master server at 127.18.70.190:37777
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
I20260812 06:57:15.207000 19426 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:15.207770 19426 heartbeater.cc:511] Master 127.18.70.190:37777 requested a full tablet report, sending...
I20260812 06:57:15.209292 18816 ts_manager.cc:194] Registered new tserver with Master: fe513c1e9d5d420e84f39a4349e3d09e (127.18.70.130:37403)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
I20260812 06:57:15.210309 18816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:57405
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 06:57:15.230361 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:37777
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:46711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:15.553957 19438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:15.554239 19438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:15.554378 19438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:15.561592 19438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:15.561712 19438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:15.561866 19438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:57:15.571571 19438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:37777
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:15.572844 19438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:15.574189 19438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:15.586696 19451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:15.586791 19446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:15.586720 19447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:15.587754 19438 server_base.cc:1034] running on GCE node
I20260812 06:57:15.588295 19438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:15.589150 19438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:15.590354 19438 hybrid_clock.cc:648] HybridClock initialized: now 1786517835590295 us; error 37 us; skew 500 ppm
I20260812 06:57:15.590642 19438 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:15 dist-test-slave-tc2s krb5kdc[18722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517835, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:15.593619 19438 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:57:15.595057 19438 webserver.cc:460] Webserver started at http://127.18.70.131:42377/ using document root <none> and password file <none>
I20260812 06:57:15.595700 19438 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:15.595813 19438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:15.596122 19438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:15.598951 19438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "c16af39a3d494adfbaf072b3123b38fd"
format_stamp: "Formatted at 2026-08-12 06:57:15 on dist-test-slave-tc2s"
server_key: "212f79c84e5e81c8edbae0d15a4086cb"
server_key_iv: "92921ce5c6bed0dcdb9961ae42ae2057"
server_key_version: "encryptionkey@0"
I20260812 06:57:15.599706 19438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "c16af39a3d494adfbaf072b3123b38fd"
format_stamp: "Formatted at 2026-08-12 06:57:15 on dist-test-slave-tc2s"
server_key: "212f79c84e5e81c8edbae0d15a4086cb"
server_key_iv: "92921ce5c6bed0dcdb9961ae42ae2057"
server_key_version: "encryptionkey@0"
I20260812 06:57:15.604723 19438 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 06:57:15.608011 19469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:15.609232 19438 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 06:57:15.609383 19438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "c16af39a3d494adfbaf072b3123b38fd"
format_stamp: "Formatted at 2026-08-12 06:57:15 on dist-test-slave-tc2s"
server_key: "212f79c84e5e81c8edbae0d15a4086cb"
server_key_iv: "92921ce5c6bed0dcdb9961ae42ae2057"
server_key_version: "encryptionkey@0"
I20260812 06:57:15.609591 19438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:15.626274 19438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:15.629978 19438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:15.630225 19438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:15.631114 19438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:15.632408 19438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:15.632493 19438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:15.632612 19438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:15.632665 19438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:15.663371 19438 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:42519
I20260812 06:57:15.663420 19691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:42519 every 8 connection(s)
I20260812 06:57:15.664626 19438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:57:15.669020 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 19438
I20260812 06:57:15.669222 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:57:15.669759 18714 external_mini_cluster.cc:1428] Setting key 0b0553e26474abe2c790cafb706aace1
Aug 12 06:57:15 dist-test-slave-tc2s krb5kdc[18722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517835, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:15.684617 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:15.667258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:34469 (local address 127.18.70.190:37777)
0812 06:57:15.667486 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:15.667493 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:15.668669 (+ 1176us) server_negotiation.cc:407] Connection header received
0812 06:57:15.671176 (+ 2507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:15.671182 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:15.671267 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:15.671361 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:15.673213 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.674056 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.675551 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.675936 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.676027 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:15.679261 (+ 3234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:15.679266 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:15.679269 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:15.679302 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:15.681612 (+ 2310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.682358 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.682364 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.682366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.682495 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.682913 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.682918 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.682922 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.683197 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:15.683331 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:15.683999 (+ 668us) server_negotiation.cc:299] Negotiation successful
0812 06:57:15.684222 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 06:57:15.685647 19697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:15.667776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:37777 (local address 127.18.70.131:34469)
0812 06:57:15.668505 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:15.668544 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:15.670844 (+ 2300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:15.671673 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:15.671684 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:15.672442 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:15.673042 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:15.673068 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.674194 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.674198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:15.675432 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:15.675445 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.676121 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.676126 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:15.676313 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:15.676927 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:15.676949 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:15.679063 (+ 2114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:15.681748 (+ 2685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:15.681757 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:15.681773 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:15.682242 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:15.682601 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:15.682606 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:15.682610 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:15.682797 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:15.683323 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:15.683331 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:15.683651 (+ 320us) client_negotiation.cc:769] Sending connection context
0812 06:57:15.683874 (+ 223us) client_negotiation.cc:240] Negotiation successful
0812 06:57:15.684389 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":274,"threads_started":1}
I20260812 06:57:15.686836 19692 heartbeater.cc:347] Connected to a master server at 127.18.70.190:37777
I20260812 06:57:15.687095 19692 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:15.687794 19692 heartbeater.cc:511] Master 127.18.70.190:37777 requested a full tablet report, sending...
I20260812 06:57:15.689061 18816 ts_manager.cc:194] Registered new tserver with Master: c16af39a3d494adfbaf072b3123b38fd (127.18.70.131:42519)
I20260812 06:57:15.689834 18816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:34469
I20260812 06:57:15.697513 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:57:15 dist-test-slave-tc2s krb5kdc[18722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517835, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:57:15 dist-test-slave-tc2s krb5kdc[18722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517835, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:57:15.741293 19172 heartbeater.cc:503] Master 127.18.70.190:37777 was elected leader, sending a full tablet report...
I20260812 06:57:15.741885 19709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:15.727802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60112 (local address 127.18.70.129:32875)
0812 06:57:15.728401 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:15.728408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:15.728436 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:57:15.728583 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:15.728590 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:15.728792 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:15.728911 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:15.730403 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.731385 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.732554 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.733090 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.733181 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:15.736892 (+ 3711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:15.736902 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:15.736927 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:15.736963 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:15.739498 (+ 2535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.740075 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.740082 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.740084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.740199 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.740487 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.740490 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.740492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.740805 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:15.741033 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:15.741267 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 06:57:15.741527 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":324,"threads_started":1}
W20260812 06:57:15.743257 19014 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60112
Aug 12 06:57:15 dist-test-slave-tc2s krb5kdc[18722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:57:15 dist-test-slave-tc2s krb5kdc[18722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:57:15.785593 19709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:15.772677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60114 (local address 127.18.70.129:32875)
0812 06:57:15.772934 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:15.772941 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:15.773150 (+ 209us) server_negotiation.cc:407] Connection header received
0812 06:57:15.773297 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:15.773300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:15.773400 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:15.773484 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:15.774847 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.775562 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.776693 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.777139 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.777233 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:15.780872 (+ 3639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:15.780878 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:15.780881 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:15.780921 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:15.783514 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.784094 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.784098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.784100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.784220 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.784486 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.784489 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.784491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.784737 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:15.784920 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:15.785135 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 06:57:15.785301 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 06:57:15.787048 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 18928
I20260812 06:57:15.799134 19709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:15.787926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60126 (local address 127.18.70.129:32875)
0812 06:57:15.788104 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:15.788109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:15.788383 (+ 274us) server_negotiation.cc:407] Connection header received
0812 06:57:15.788525 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:15.788528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:15.788582 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:15.788656 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:15.789783 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.790524 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.791756 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.792188 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.792293 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:15.794473 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:15.794477 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:15.794480 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:15.794508 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:15.796740 (+ 2232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.797343 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.797349 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.797352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.797486 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.797821 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.797826 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.797830 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.798116 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:15.798347 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:15.798616 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 06:57:15.798812 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 06:57:15.799786 19161 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:15.882959 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 18928
I20260812 06:57:15.907668 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 19181
Aug 12 06:57:15 dist-test-slave-tc2s krb5kdc[18722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 06:57:15.922897 19722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:15.908511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59976 (local address 127.18.70.130:37403)
0812 06:57:15.908980 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:15.908987 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:15.909012 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:57:15.909073 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:15.909080 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:15.909282 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:15.909438 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:15.910688 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.911674 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.913027 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:15.913649 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:15.913774 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:15.917833 (+ 4059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:15.917844 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:15.917859 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:15.917914 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:15.920430 (+ 2516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.921047 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.921054 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.921056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.921174 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:15.921568 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:15.921570 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:15.921572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:15.921923 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:15.922173 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:15.922401 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 06:57:15.922610 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":221,"threads_started":1}
I20260812 06:57:15.924129 19414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:16.004976 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 19181
I20260812 06:57:16.026823 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 19438
Aug 12 06:57:16 dist-test-slave-tc2s krb5kdc[18722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 06:57:16.042223 19724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:16.027807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.18.70.131:42519)
0812 06:57:16.028415 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:16.028422 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:16.028452 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:57:16.028550 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:16.028557 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:16.028770 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:16.028956 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:16.030228 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:16.031245 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:16.032496 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:16.033046 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:16.033154 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:16.037259 (+ 4105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:16.037270 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:16.037284 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:16.037315 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:16.039837 (+ 2522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:16.040506 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:16.040512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:16.040514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:16.040634 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:16.040917 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:16.040919 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:16.040921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:16.041230 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:16.041460 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:16.041666 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 06:57:16.041858 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":297,"threads_started":1}
I20260812 06:57:16.043555 19681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:16.127611 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 19438
I20260812 06:57:16.146250 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 18747
I20260812 06:57:16.147444 18870 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:16.248852 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 18747
2026-08-12T06:57:16Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4008 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:57:16 dist-test-slave-tc2s krb5kdc[19730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:57:16 dist-test-slave-tc2s krb5kdc[19730](info): set up 2 sockets
Aug 12 06:57:16 dist-test-slave-tc2s krb5kdc[19730](info): commencing operation
krb5kdc: starting...
W20260812 06:57:17.493574 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.001s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:57:17 dist-test-slave-tc2s krb5kdc[19730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:57:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:57:17.666975 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:34489
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:34489
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:17.980134 19757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:17.980410 19757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:17.980546 19757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:17.987534 19757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:17.987629 19757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:17.987702 19757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:17.987776 19757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:17.987835 19757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:57:17.997220 19757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:34489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:34489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:17.998495 19757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:17.999804 19757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:18.010928 19765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:18.010958 19770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:18.010993 19767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:18.011868 19757 server_base.cc:1034] running on GCE node
I20260812 06:57:18.012643 19757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:18.013942 19757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:18.015144 19757 hybrid_clock.cc:648] HybridClock initialized: now 1786517838015098 us; error 39 us; skew 500 ppm
I20260812 06:57:18.015470 19757 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:18 dist-test-slave-tc2s krb5kdc[19730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517838, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:18.018358 19757 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:57:18.020164 19757 webserver.cc:460] Webserver started at http://127.18.70.190:41493/ using document root <none> and password file <none>
I20260812 06:57:18.021034 19757 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:18.021173 19757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:18.021539 19757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:18.025552 19757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "a657dbbeb4904c718ba1a0d91bd8c120"
format_stamp: "Formatted at 2026-08-12 06:57:18 on dist-test-slave-tc2s"
server_key: "a4a316cf428ea180686b7c0b8e5a1a54"
server_key_iv: "51914f307c0db425742302f6b50f2c3b"
server_key_version: "encryptionkey@0"
I20260812 06:57:18.026755 19757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "a657dbbeb4904c718ba1a0d91bd8c120"
format_stamp: "Formatted at 2026-08-12 06:57:18 on dist-test-slave-tc2s"
server_key: "a4a316cf428ea180686b7c0b8e5a1a54"
server_key_iv: "51914f307c0db425742302f6b50f2c3b"
server_key_version: "encryptionkey@0"
I20260812 06:57:18.033085 19757 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 06:57:18.037614 19783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:18.041069 19757 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260812 06:57:18.041266 19757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "a657dbbeb4904c718ba1a0d91bd8c120"
format_stamp: "Formatted at 2026-08-12 06:57:18 on dist-test-slave-tc2s"
server_key: "a4a316cf428ea180686b7c0b8e5a1a54"
server_key_iv: "51914f307c0db425742302f6b50f2c3b"
server_key_version: "encryptionkey@0"
I20260812 06:57:18.041481 19757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:18.057497 19757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:18.062861 19757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:18.063207 19757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:18.081586 19757 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:34489
I20260812 06:57:18.081605 19875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:34489 every 8 connection(s)
I20260812 06:57:18.082939 19757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:18.086517 19876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:18.092904 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 19757
I20260812 06:57:18.093153 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:18.094007 18714 external_mini_cluster.cc:1428] Setting key 8e893ce568a48baa42415621a470307e
I20260812 06:57:18.097157 19876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120: Bootstrap starting.
I20260812 06:57:18.100587 19876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:18.101759 19876 log.cc:824] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:18.104382 19876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120: No bootstrap required, opened a new log
Aug 12 06:57:18 dist-test-slave-tc2s krb5kdc[19730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:18.111882 19876 raft_consensus.cc:348] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657dbbeb4904c718ba1a0d91bd8c120" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34489 } }
I20260812 06:57:18.112262 19876 raft_consensus.cc:374] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:18.112375 19876 raft_consensus.cc:729] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a657dbbeb4904c718ba1a0d91bd8c120, State: Initialized, Role: FOLLOWER
I20260812 06:57:18.112974 19876 consensus_queue.cc:260] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657dbbeb4904c718ba1a0d91bd8c120" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34489 } }
I20260812 06:57:18.113207 19876 raft_consensus.cc:388] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:18.113337 19876 raft_consensus.cc:482] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:18.113515 19876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:18.115505 19880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:18.096020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43204 (local address 127.18.70.190:34489)
0812 06:57:18.096744 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:18.096755 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:18.096796 (+ 41us) server_negotiation.cc:407] Connection header received
0812 06:57:18.098558 (+ 1762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:18.098582 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:18.098935 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:18.099240 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:18.101079 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:18.102433 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:18.103704 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:18.104345 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:18.104508 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:18.108313 (+ 3805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:18.108321 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:18.108334 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:18.108371 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:18.111392 (+ 3021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:18.112017 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:18.112023 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:18.112030 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:18.112197 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:18.112652 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:18.112656 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:18.112660 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:18.113238 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:18.113577 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:18.114103 (+ 526us) server_negotiation.cc:299] Negotiation successful
0812 06:57:18.114537 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":333,"threads_started":1}
I20260812 06:57:18.115940 19876 raft_consensus.cc:504] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657dbbeb4904c718ba1a0d91bd8c120" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34489 } }
I20260812 06:57:18.116422 19876 leader_election.cc:302] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a657dbbeb4904c718ba1a0d91bd8c120; no voters:
I20260812 06:57:18.117012 19876 leader_election.cc:288] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:18.117074 19883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:18.118449 19883 raft_consensus.cc:686] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [term 1 LEADER]: Becoming Leader. State: Replica: a657dbbeb4904c718ba1a0d91bd8c120, State: Running, Role: LEADER
I20260812 06:57:18.119045 19876 sys_catalog.cc:564] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:18.119041 19883 consensus_queue.cc:237] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657dbbeb4904c718ba1a0d91bd8c120" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34489 } }
I20260812 06:57:18.121691 19887 sys_catalog.cc:455] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a657dbbeb4904c718ba1a0d91bd8c120. Latest consensus state: current_term: 1 leader_uuid: "a657dbbeb4904c718ba1a0d91bd8c120" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657dbbeb4904c718ba1a0d91bd8c120" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34489 } } }
I20260812 06:57:18.122113 19887 sys_catalog.cc:458] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:18.122416 19885 sys_catalog.cc:455] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a657dbbeb4904c718ba1a0d91bd8c120" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a657dbbeb4904c718ba1a0d91bd8c120" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34489 } } }
I20260812 06:57:18.122686 19885 sys_catalog.cc:458] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120 [sys.catalog]: This master's current role is: LEADER
W20260812 06:57:18.132933 19918 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:57:18.133407 19918 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:57:18.133622 19896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:18.135746 19896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:18.143812 19896 catalog_manager.cc:1347] Generated new cluster ID: 0cb88bffbcf846e79d3c33ab12dfd9c3
I20260812 06:57:18.143908 19896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:18.160732 19896 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:18.161962 19896 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:18.170317 19896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a657dbbeb4904c718ba1a0d91bd8c120: Generated new TSK 0
I20260812 06:57:18.171232 19896 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:57:18.217170 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34489
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:18.537003 19925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:18.537256 19925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:18.537386 19925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:18.544472 19925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:18.544579 19925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:18.544731 19925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:57:18.554250 19925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34489
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:18.555454 19925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:18.556746 19925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:18.568982 19934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:18.569031 19935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:18.569052 19939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:18.569742 19925 server_base.cc:1034] running on GCE node
I20260812 06:57:18.570327 19925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:18.571192 19925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:18.572386 19925 hybrid_clock.cc:648] HybridClock initialized: now 1786517838572332 us; error 41 us; skew 500 ppm
I20260812 06:57:18.572686 19925 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:18 dist-test-slave-tc2s krb5kdc[19730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517838, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:18.575757 19925 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:57:18.577075 19925 webserver.cc:460] Webserver started at http://127.18.70.129:38799/ using document root <none> and password file <none>
I20260812 06:57:18.577683 19925 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:18.577782 19925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:18.578092 19925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:18.580893 19925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "017b870e998f41f5815e3c2944d2b037"
format_stamp: "Formatted at 2026-08-12 06:57:18 on dist-test-slave-tc2s"
server_key: "c6965d0133cea730adca850a54e8aabd"
server_key_iv: "90ff967ff9da397093dbe24528b5278d"
server_key_version: "encryptionkey@0"
I20260812 06:57:18.581655 19925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "017b870e998f41f5815e3c2944d2b037"
format_stamp: "Formatted at 2026-08-12 06:57:18 on dist-test-slave-tc2s"
server_key: "c6965d0133cea730adca850a54e8aabd"
server_key_iv: "90ff967ff9da397093dbe24528b5278d"
server_key_version: "encryptionkey@0"
I20260812 06:57:18.586419 19925 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 06:57:18.589614 19954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:18.590834 19925 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:18.590960 19925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "017b870e998f41f5815e3c2944d2b037"
format_stamp: "Formatted at 2026-08-12 06:57:18 on dist-test-slave-tc2s"
server_key: "c6965d0133cea730adca850a54e8aabd"
server_key_iv: "90ff967ff9da397093dbe24528b5278d"
server_key_version: "encryptionkey@0"
I20260812 06:57:18.591116 19925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:18.609489 19925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:18.613201 19925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:18.613435 19925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:18.614334 19925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:18.615645 19925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:18.615713 19925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:18.615828 19925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:18.615876 19925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:18.645591 19925 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:41359
I20260812 06:57:18.645612 20167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:41359 every 8 connection(s)
I20260812 06:57:18.646950 19925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:57:18.652732 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 19925
I20260812 06:57:18.652933 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:57:18.653530 18714 external_mini_cluster.cc:1428] Setting key ecbc772b19e48d1a87e0af207ec28097
Aug 12 06:57:18 dist-test-slave-tc2s krb5kdc[19730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517838, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:18.666728 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:18.649441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:43255 (local address 127.18.70.190:34489)
0812 06:57:18.649843 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:18.649848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:18.650887 (+ 1039us) server_negotiation.cc:407] Connection header received
0812 06:57:18.652736 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:18.652741 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:18.652833 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:18.652942 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:18.654654 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:18.655485 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:18.657030 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:18.657624 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:18.657751 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:18.661123 (+ 3372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:18.661129 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:18.661134 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:18.661173 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:18.663721 (+ 2548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:18.664560 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:18.664564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:18.664567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:18.664677 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:18.665096 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:18.665099 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:18.665101 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:18.665361 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:18.665466 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:18.666314 (+ 848us) server_negotiation.cc:299] Negotiation successful
0812 06:57:18.666473 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":191,"threads_started":1}
I20260812 06:57:18.668072 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:18.650033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:34489 (local address 127.18.70.129:43255)
0812 06:57:18.650728 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:18.650775 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:18.652470 (+ 1695us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:18.653193 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:18.653201 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:18.653764 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:18.654483 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:18.654504 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:18.655636 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:18.655640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:18.656876 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:18.656889 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:18.657814 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:18.657819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:18.658058 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:18.658669 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:18.658697 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:18.660894 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:18.663860 (+ 2966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:18.663868 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:18.663882 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:18.664459 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:18.664770 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:18.664774 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:18.664777 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:18.665007 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:18.665485 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:18.665493 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:18.665961 (+ 468us) client_negotiation.cc:769] Sending connection context
0812 06:57:18.666242 (+ 281us) client_negotiation.cc:240] Negotiation successful
0812 06:57:18.666721 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":261,"threads_started":1}
I20260812 06:57:18.669571 20168 heartbeater.cc:347] Connected to a master server at 127.18.70.190:34489
I20260812 06:57:18.669837 20168 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:18.670691 20168 heartbeater.cc:511] Master 127.18.70.190:34489 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
I20260812 06:57:18.672806 19811 ts_manager.cc:194] Registered new tserver with Master: 017b870e998f41f5815e3c2944d2b037 (127.18.70.129:41359)
I20260812 06:57:18.674275 19811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:43255
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 06:57:18.694468 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34489
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:19.008358 20184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:19.008623 20184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:19.008744 20184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:19.015761 20184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:19.015854 20184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:19.016003 20184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:57:19.025411 20184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34489
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:19.026650 20184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:19.028024 20184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:19.040437 20190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:19.040354 20196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:19.040398 20193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:19.041193 20184 server_base.cc:1034] running on GCE node
I20260812 06:57:19.041786 20184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:19.042687 20184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:19.043891 20184 hybrid_clock.cc:648] HybridClock initialized: now 1786517839043850 us; error 35 us; skew 500 ppm
I20260812 06:57:19.044178 20184 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:19 dist-test-slave-tc2s krb5kdc[19730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517839, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:19.052054 20184 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:57:19.053452 20184 webserver.cc:460] Webserver started at http://127.18.70.130:33337/ using document root <none> and password file <none>
I20260812 06:57:19.054179 20184 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:19.054296 20184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:19.054598 20184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:19.057379 20184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "e6cb144c21e34abdbe7d839f4ddd38b0"
format_stamp: "Formatted at 2026-08-12 06:57:19 on dist-test-slave-tc2s"
server_key: "e548986ffab05653775de386462f9568"
server_key_iv: "1d92c17409c6494801406a936b08c21c"
server_key_version: "encryptionkey@0"
I20260812 06:57:19.058173 20184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "e6cb144c21e34abdbe7d839f4ddd38b0"
format_stamp: "Formatted at 2026-08-12 06:57:19 on dist-test-slave-tc2s"
server_key: "e548986ffab05653775de386462f9568"
server_key_iv: "1d92c17409c6494801406a936b08c21c"
server_key_version: "encryptionkey@0"
I20260812 06:57:19.062952 20184 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 06:57:19.066177 20211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:19.067445 20184 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 06:57:19.067613 20184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "e6cb144c21e34abdbe7d839f4ddd38b0"
format_stamp: "Formatted at 2026-08-12 06:57:19 on dist-test-slave-tc2s"
server_key: "e548986ffab05653775de386462f9568"
server_key_iv: "1d92c17409c6494801406a936b08c21c"
server_key_version: "encryptionkey@0"
I20260812 06:57:19.067786 20184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:19.078686 20184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:19.082700 20184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:19.082957 20184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:19.083906 20184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:19.085184 20184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:19.085260 20184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:19.085381 20184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:19.085434 20184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:19.116163 20184 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:34219
I20260812 06:57:19.116201 20422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:34219 every 8 connection(s)
I20260812 06:57:19.117375 20184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:57:19.118882 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 20184
I20260812 06:57:19.119091 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:57:19.119647 18714 external_mini_cluster.cc:1428] Setting key cf62b245d09a7c795d77c9ac6c05bf42
Aug 12 06:57:19 dist-test-slave-tc2s krb5kdc[19730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517839, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:19.138098 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:19.120484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:58493 (local address 127.18.70.190:34489)
0812 06:57:19.120665 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:19.120671 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:19.121492 (+ 821us) server_negotiation.cc:407] Connection header received
0812 06:57:19.123419 (+ 1927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:19.123424 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:19.123508 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:19.123608 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:19.125028 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.125999 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.127755 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.128184 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.128279 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:19.132216 (+ 3937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:19.132221 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:19.132225 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:19.132259 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:19.134862 (+ 2603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:19.135754 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:19.135759 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:19.135762 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:19.135917 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:19.136390 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:19.136394 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:19.136396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:19.136678 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:19.136805 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:19.137621 (+ 816us) server_negotiation.cc:299] Negotiation successful
0812 06:57:19.137809 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
I20260812 06:57:19.139271 20426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:19.120599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:34489 (local address 127.18.70.130:58493)
0812 06:57:19.121356 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:19.121400 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:19.123143 (+ 1743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:19.123791 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:19.123798 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:19.124314 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:19.124846 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:19.124863 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.126125 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.126129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:19.127602 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:19.127624 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.128400 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.128408 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:19.128675 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:19.129376 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:19.129402 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:19.131983 (+ 2581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:19.135009 (+ 3026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:19.135019 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:19.135034 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:19.135612 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:19.136030 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:19.136034 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:19.136038 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:19.136278 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:19.136809 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:19.136816 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:19.137237 (+ 421us) client_negotiation.cc:769] Sending connection context
0812 06:57:19.137561 (+ 324us) client_negotiation.cc:240] Negotiation successful
0812 06:57:19.138114 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":315,"threads_started":1}
I20260812 06:57:19.140635 20423 heartbeater.cc:347] Connected to a master server at 127.18.70.190:34489
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
I20260812 06:57:19.140944 20423 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:19.141736 20423 heartbeater.cc:511] Master 127.18.70.190:34489 requested a full tablet report, sending...
I20260812 06:57:19.143316 19811 ts_manager.cc:194] Registered new tserver with Master: e6cb144c21e34abdbe7d839f4ddd38b0 (127.18.70.130:34219)
I20260812 06:57:19.144120 19811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:58493
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 06:57:19.161986 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34489
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:19.475178 20434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:19.475455 20434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:19.475589 20434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:19.482661 20434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:19.482770 20434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:19.482921 20434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:57:19.492445 20434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34489
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:19.493621 20434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:19.494982 20434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:19.507421 20441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:19.507385 20451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:19.507421 20442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:19.511144 20434 server_base.cc:1034] running on GCE node
I20260812 06:57:19.511720 20434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:19.512595 20434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:19.513795 20434 hybrid_clock.cc:648] HybridClock initialized: now 1786517839513747 us; error 41 us; skew 500 ppm
I20260812 06:57:19.514115 20434 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:19 dist-test-slave-tc2s krb5kdc[19730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517839, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:19.517105 20434 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:57:19.518553 20434 webserver.cc:460] Webserver started at http://127.18.70.131:40579/ using document root <none> and password file <none>
I20260812 06:57:19.519222 20434 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:19.519320 20434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:19.519619 20434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:19.522475 20434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "3eae4192f48c4793b63c40273f375c8c"
format_stamp: "Formatted at 2026-08-12 06:57:19 on dist-test-slave-tc2s"
server_key: "2e49e82d7a96dc6e9bd2c5c11b00237c"
server_key_iv: "44dc74e5d388b4839e7537b77034eb14"
server_key_version: "encryptionkey@0"
I20260812 06:57:19.523175 20434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "3eae4192f48c4793b63c40273f375c8c"
format_stamp: "Formatted at 2026-08-12 06:57:19 on dist-test-slave-tc2s"
server_key: "2e49e82d7a96dc6e9bd2c5c11b00237c"
server_key_iv: "44dc74e5d388b4839e7537b77034eb14"
server_key_version: "encryptionkey@0"
I20260812 06:57:19.528072 20434 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 06:57:19.531370 20461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:19.532605 20434 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:57:19.532733 20434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "3eae4192f48c4793b63c40273f375c8c"
format_stamp: "Formatted at 2026-08-12 06:57:19 on dist-test-slave-tc2s"
server_key: "2e49e82d7a96dc6e9bd2c5c11b00237c"
server_key_iv: "44dc74e5d388b4839e7537b77034eb14"
server_key_version: "encryptionkey@0"
I20260812 06:57:19.532887 20434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:19.559675 20434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:19.563606 20434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:19.563834 20434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:19.564687 20434 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:19.566036 20434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:19.566107 20434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:19.566195 20434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:19.566237 20434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:19.595984 20434 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:46663
I20260812 06:57:19.596052 20679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:46663 every 8 connection(s)
I20260812 06:57:19.597203 20434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:57:19.606503 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 20434
I20260812 06:57:19.606670 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:57:19.607100 18714 external_mini_cluster.cc:1428] Setting key 0463c20750bcf644b1f8efeb312a0956
Aug 12 06:57:19 dist-test-slave-tc2s krb5kdc[19730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517839, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:19.616106 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:19.599760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:58899 (local address 127.18.70.190:34489)
0812 06:57:19.599950 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:19.599955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:19.601081 (+ 1126us) server_negotiation.cc:407] Connection header received
0812 06:57:19.602874 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:19.602878 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:19.602957 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:19.603042 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:19.604439 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.605188 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.606724 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.607161 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.607279 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:19.611071 (+ 3792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:19.611076 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:19.611080 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:19.611114 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:19.613485 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:19.614246 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:19.614251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:19.614253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:19.614400 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:19.614742 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:19.614745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:19.614748 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:19.615012 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:19.615126 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:19.615678 (+ 552us) server_negotiation.cc:299] Negotiation successful
0812 06:57:19.615861 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 06:57:19.616963 20682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:19.600206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:34489 (local address 127.18.70.131:58899)
0812 06:57:19.600912 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:19.600957 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:19.602635 (+ 1678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:19.603217 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:19.603224 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:19.603723 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:19.604283 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:19.604300 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.605292 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.605295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:19.606571 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:19.606593 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.607395 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.607403 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:19.607694 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:19.608370 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:19.608402 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:19.610866 (+ 2464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:19.613619 (+ 2753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:19.613626 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:19.613637 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:19.614128 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:19.614483 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:19.614486 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:19.614488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:19.614662 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:19.615103 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:19.615109 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:19.615391 (+ 282us) client_negotiation.cc:769] Sending connection context
0812 06:57:19.615599 (+ 208us) client_negotiation.cc:240] Negotiation successful
0812 06:57:19.615958 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":273,"threads_started":1}
I20260812 06:57:19.618243 20680 heartbeater.cc:347] Connected to a master server at 127.18.70.190:34489
I20260812 06:57:19.618516 20680 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:19.619279 20680 heartbeater.cc:511] Master 127.18.70.190:34489 requested a full tablet report, sending...
I20260812 06:57:19.620653 19811 ts_manager.cc:194] Registered new tserver with Master: 3eae4192f48c4793b63c40273f375c8c (127.18.70.131:46663)
I20260812 06:57:19.621559 19811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:58899
I20260812 06:57:19.622499 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:57:19.640445 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:19.628680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43208 (local address 127.18.70.190:34489)
0812 06:57:19.628814 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:19.628818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:19.629287 (+ 469us) server_negotiation.cc:407] Connection header received
0812 06:57:19.629451 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:19.629455 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:19.629514 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:19.629588 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:19.630992 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.631694 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.633029 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.633416 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.633500 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:19.635702 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:19.635707 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:19.635710 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:19.635740 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:19.638169 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:19.638748 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:19.638751 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:19.638753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:19.638876 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:19.639148 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:19.639151 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:19.639153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:19.639424 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:19.639599 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:19.639937 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 06:57:19.640145 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:57:19.646613 19811 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:57:19.653347 19811 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:57:19.677290 20168 heartbeater.cc:503] Master 127.18.70.190:34489 was elected leader, sending a full tablet report...
I20260812 06:57:19.688089 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:19.665041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36092 (local address 127.18.70.131:46663)
0812 06:57:19.678931 (+ 13890us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:19.678940 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:19.679679 (+ 739us) server_negotiation.cc:407] Connection header received
0812 06:57:19.680006 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:19.680015 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:19.680273 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:19.680453 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:19.681594 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.683538 (+ 1944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.685818 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.687021 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.687144 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:19.687362 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:19.687604 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 06:57:19.687763 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13702,"thread_start_us":13552,"threads_started":1}
I20260812 06:57:19.688166 20703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:19.664561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:46663 (local address 127.0.0.1:36092)
0812 06:57:19.679493 (+ 14932us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:19.679542 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:19.679732 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:19.680782 (+ 1050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:19.680786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:19.680814 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:19.681340 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:19.681353 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.683694 (+ 2341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.683699 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:19.685673 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:19.685684 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.687209 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.687219 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:19.687369 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:19.687432 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 06:57:19.687546 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 06:57:19.687733 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14685,"mutex_wait_us":47,"spinlock_wait_cycles":2432,"thread_start_us":15344,"threads_started":1}
I20260812 06:57:19.688426 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:19.665469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54338 (local address 127.18.70.129:41359)
0812 06:57:19.677363 (+ 11894us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:19.677373 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:19.679810 (+ 2437us) server_negotiation.cc:407] Connection header received
0812 06:57:19.680275 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:19.680282 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:19.680520 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:19.680695 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:19.681395 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.683104 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.685265 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.686733 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.686892 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:19.687140 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:19.687929 (+ 789us) server_negotiation.cc:299] Negotiation successful
0812 06:57:19.688095 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11708,"thread_start_us":12716,"threads_started":1}
I20260812 06:57:19.689111 20700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:19.664750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:41359 (local address 127.0.0.1:54338)
0812 06:57:19.679698 (+ 14948us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:19.679715 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:19.679850 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:19.680719 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:19.680726 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:19.680755 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:19.681176 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:19.681192 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.683257 (+ 2065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.683262 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:19.685084 (+ 1822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:19.685099 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.686924 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.686931 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:19.687731 (+ 800us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:19.687763 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 06:57:19.688618 (+ 855us) client_negotiation.cc:240] Negotiation successful
0812 06:57:19.688751 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14832,"mutex_wait_us":619,"thread_start_us":14369,"threads_started":1}
I20260812 06:57:19.690116 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:19.681320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:34219 (local address 127.0.0.1:50866)
0812 06:57:19.681981 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:19.681997 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:19.682103 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:19.682781 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:19.682785 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:19.682809 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:19.683173 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:19.683185 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.685022 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.685031 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:19.687490 (+ 2459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:19.687502 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.689366 (+ 1864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.689372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:19.689535 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:19.689564 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 06:57:19.689645 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 06:57:19.689760 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":385,"threads_started":1}
I20260812 06:57:19.692322 20543 tablet_service.cc:1467] Processing CreateTablet for tablet 78b79d3f0546461890a3b0d30c468aac (DEFAULT_TABLE table=test-table [id=c9f2c5b5b16d41049ae2cccc12317c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:19.692664 20036 tablet_service.cc:1467] Processing CreateTablet for tablet 78b79d3f0546461890a3b0d30c468aac (DEFAULT_TABLE table=test-table [id=c9f2c5b5b16d41049ae2cccc12317c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:19.693933 20036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78b79d3f0546461890a3b0d30c468aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:19.693939 20543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78b79d3f0546461890a3b0d30c468aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:19.694718 20709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:19.680611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50866 (local address 127.18.70.130:34219)
0812 06:57:19.681454 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:19.681463 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:19.682085 (+ 622us) server_negotiation.cc:407] Connection header received
0812 06:57:19.682241 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:19.682246 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:19.682394 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:19.682556 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:19.683356 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.684907 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.687633 (+ 2726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:19.689040 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:19.689194 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:19.689375 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:19.694033 (+ 4658us) server_negotiation.cc:299] Negotiation successful
0812 06:57:19.694208 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":395,"threads_started":1}
I20260812 06:57:19.697328 20298 tablet_service.cc:1467] Processing CreateTablet for tablet 78b79d3f0546461890a3b0d30c468aac (DEFAULT_TABLE table=test-table [id=c9f2c5b5b16d41049ae2cccc12317c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:19.698390 20298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78b79d3f0546461890a3b0d30c468aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:19.708880 20711 tablet_bootstrap.cc:492] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c: Bootstrap starting.
I20260812 06:57:19.709668 20712 tablet_bootstrap.cc:492] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037: Bootstrap starting.
I20260812 06:57:19.710726 20714 tablet_bootstrap.cc:492] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0: Bootstrap starting.
I20260812 06:57:19.713598 20712 tablet_bootstrap.cc:654] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:19.713725 20714 tablet_bootstrap.cc:654] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:19.714288 20711 tablet_bootstrap.cc:654] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:19.714794 20714 log.cc:824] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:19.714875 20712 log.cc:824] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:19.715426 20711 log.cc:824] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:19.717588 20714 tablet_bootstrap.cc:492] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0: No bootstrap required, opened a new log
I20260812 06:57:19.717835 20714 ts_tablet_manager.cc:1397] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260812 06:57:19.723883 20712 tablet_bootstrap.cc:492] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037: No bootstrap required, opened a new log
I20260812 06:57:19.724157 20712 ts_tablet_manager.cc:1397] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260812 06:57:19.724443 20711 tablet_bootstrap.cc:492] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c: No bootstrap required, opened a new log
I20260812 06:57:19.724699 20711 ts_tablet_manager.cc:1397] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.008s
I20260812 06:57:19.725754 20714 raft_consensus.cc:348] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eae4192f48c4793b63c40273f375c8c" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46663 } } peers { permanent_uuid: "017b870e998f41f5815e3c2944d2b037" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 41359 } } peers { permanent_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34219 } }
I20260812 06:57:19.726186 20714 raft_consensus.cc:374] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:19.726279 20714 raft_consensus.cc:729] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6cb144c21e34abdbe7d839f4ddd38b0, State: Initialized, Role: FOLLOWER
I20260812 06:57:19.726869 20714 consensus_queue.cc:260] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eae4192f48c4793b63c40273f375c8c" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46663 } } peers { permanent_uuid: "017b870e998f41f5815e3c2944d2b037" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 41359 } } peers { permanent_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34219 } }
I20260812 06:57:19.728029 20423 heartbeater.cc:503] Master 127.18.70.190:34489 was elected leader, sending a full tablet report...
I20260812 06:57:19.729802 20714 ts_tablet_manager.cc:1428] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
I20260812 06:57:19.734479 20712 raft_consensus.cc:348] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eae4192f48c4793b63c40273f375c8c" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46663 } } peers { permanent_uuid: "017b870e998f41f5815e3c2944d2b037" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 41359 } } peers { permanent_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34219 } }
I20260812 06:57:19.734926 20712 raft_consensus.cc:374] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:19.734681 20711 raft_consensus.cc:348] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eae4192f48c4793b63c40273f375c8c" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46663 } } peers { permanent_uuid: "017b870e998f41f5815e3c2944d2b037" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 41359 } } peers { permanent_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34219 } }
I20260812 06:57:19.735033 20712 raft_consensus.cc:729] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017b870e998f41f5815e3c2944d2b037, State: Initialized, Role: FOLLOWER
I20260812 06:57:19.735062 20711 raft_consensus.cc:374] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:19.735144 20711 raft_consensus.cc:729] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eae4192f48c4793b63c40273f375c8c, State: Initialized, Role: FOLLOWER
I20260812 06:57:19.735671 20711 consensus_queue.cc:260] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eae4192f48c4793b63c40273f375c8c" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46663 } } peers { permanent_uuid: "017b870e998f41f5815e3c2944d2b037" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 41359 } } peers { permanent_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34219 } }
I20260812 06:57:19.735671 20712 consensus_queue.cc:260] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eae4192f48c4793b63c40273f375c8c" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46663 } } peers { permanent_uuid: "017b870e998f41f5815e3c2944d2b037" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 41359 } } peers { permanent_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34219 } }
I20260812 06:57:19.737226 20680 heartbeater.cc:503] Master 127.18.70.190:34489 was elected leader, sending a full tablet report...
I20260812 06:57:19.737411 20711 ts_tablet_manager.cc:1428] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260812 06:57:19.737725 20712 ts_tablet_manager.cc:1428] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260812 06:57:19.848771 20681 tablet.cc:2369] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:57:19.869277 20424 tablet.cc:2369] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:57:19.899279 20170 tablet.cc:2369] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:57:20.014684 20722 raft_consensus.cc:482] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:57:20.015000 20722 raft_consensus.cc:504] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eae4192f48c4793b63c40273f375c8c" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46663 } } peers { permanent_uuid: "017b870e998f41f5815e3c2944d2b037" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 41359 } } peers { permanent_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34219 } }
I20260812 06:57:20.016748 20722 leader_election.cc:288] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eae4192f48c4793b63c40273f375c8c (127.18.70.131:46663), e6cb144c21e34abdbe7d839f4ddd38b0 (127.18.70.130:34219)
I20260812 06:57:20.024503 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:20.017430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:45485 (local address 127.18.70.131:46663)
0812 06:57:20.017612 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:20.017617 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:20.018066 (+ 449us) server_negotiation.cc:407] Connection header received
0812 06:57:20.018332 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:20.018339 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:20.018428 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:20.018538 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:20.019190 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.020216 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.022376 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.023546 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.023678 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:20.023736 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:20.024140 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 06:57:20.024246 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 06:57:20.024575 20724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:20.017288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:46663 (local address 127.18.70.129:45485)
0812 06:57:20.017961 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:20.017980 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:20.018148 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:20.018604 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:20.018609 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:20.018647 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:20.019025 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:20.019039 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.020349 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.020355 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:20.022172 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:20.022185 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.023754 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.023761 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:20.023934 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:20.023970 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:57:20.024081 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 06:57:20.024210 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":313,"threads_started":1}
I20260812 06:57:20.025504 20709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:20.018262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:60673 (local address 127.18.70.130:34219)
0812 06:57:20.018505 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:20.018512 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:20.018925 (+ 413us) server_negotiation.cc:407] Connection header received
0812 06:57:20.019255 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:20.019259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:20.019317 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:20.019383 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:20.020036 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.021261 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.023406 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.024521 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.024670 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:20.024739 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:20.025215 (+ 476us) server_negotiation.cc:299] Negotiation successful
0812 06:57:20.025313 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 06:57:20.025614 20725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:20.018175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:34219 (local address 127.18.70.129:60673)
0812 06:57:20.018822 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:20.018840 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:20.018943 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:20.019491 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:20.019496 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:20.019524 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:20.019893 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:20.019904 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.021422 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.021426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:20.023210 (+ 1784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:20.023226 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.024919 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.024925 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:20.025040 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:20.025062 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 06:57:20.025181 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 06:57:20.025317 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":294,"threads_started":1}
I20260812 06:57:20.025658 20587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78b79d3f0546461890a3b0d30c468aac" candidate_uuid: "017b870e998f41f5815e3c2944d2b037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eae4192f48c4793b63c40273f375c8c" is_pre_election: true
I20260812 06:57:20.026283 20587 raft_consensus.cc:2454] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017b870e998f41f5815e3c2944d2b037 in term 0.
I20260812 06:57:20.026728 20340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78b79d3f0546461890a3b0d30c468aac" candidate_uuid: "017b870e998f41f5815e3c2944d2b037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0" is_pre_election: true
I20260812 06:57:20.027014 19956 leader_election.cc:302] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017b870e998f41f5815e3c2944d2b037, 3eae4192f48c4793b63c40273f375c8c; no voters:
I20260812 06:57:20.027452 20722 raft_consensus.cc:2781] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:57:20.027602 20722 raft_consensus.cc:482] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:57:20.027571 20340 raft_consensus.cc:2454] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017b870e998f41f5815e3c2944d2b037 in term 0.
I20260812 06:57:20.027704 20722 raft_consensus.cc:3037] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:20.030229 20722 raft_consensus.cc:504] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eae4192f48c4793b63c40273f375c8c" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46663 } } peers { permanent_uuid: "017b870e998f41f5815e3c2944d2b037" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 41359 } } peers { permanent_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34219 } }
I20260812 06:57:20.030892 20722 leader_election.cc:288] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [CANDIDATE]: Term 1 election: Requested vote from peers 3eae4192f48c4793b63c40273f375c8c (127.18.70.131:46663), e6cb144c21e34abdbe7d839f4ddd38b0 (127.18.70.130:34219)
I20260812 06:57:20.031324 20340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78b79d3f0546461890a3b0d30c468aac" candidate_uuid: "017b870e998f41f5815e3c2944d2b037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0"
I20260812 06:57:20.031304 20587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78b79d3f0546461890a3b0d30c468aac" candidate_uuid: "017b870e998f41f5815e3c2944d2b037" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eae4192f48c4793b63c40273f375c8c"
I20260812 06:57:20.031497 20587 raft_consensus.cc:3037] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:20.031522 20340 raft_consensus.cc:3037] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:20.070227 20340 raft_consensus.cc:2454] T 78b79d3f0546461890a3b0d30c468aac P e6cb144c21e34abdbe7d839f4ddd38b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017b870e998f41f5815e3c2944d2b037 in term 1.
I20260812 06:57:20.070245 20587 raft_consensus.cc:2454] T 78b79d3f0546461890a3b0d30c468aac P 3eae4192f48c4793b63c40273f375c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017b870e998f41f5815e3c2944d2b037 in term 1.
I20260812 06:57:20.070854 19956 leader_election.cc:302] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017b870e998f41f5815e3c2944d2b037, 3eae4192f48c4793b63c40273f375c8c; no voters:
I20260812 06:57:20.071216 20722 raft_consensus.cc:2781] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:20.071796 20722 raft_consensus.cc:686] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [term 1 LEADER]: Becoming Leader. State: Replica: 017b870e998f41f5815e3c2944d2b037, State: Running, Role: LEADER
I20260812 06:57:20.072333 20722 consensus_queue.cc:237] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eae4192f48c4793b63c40273f375c8c" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46663 } } peers { permanent_uuid: "017b870e998f41f5815e3c2944d2b037" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 41359 } } peers { permanent_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34219 } }
I20260812 06:57:20.077195 19811 catalog_manager.cc:5495] T 78b79d3f0546461890a3b0d30c468aac P 017b870e998f41f5815e3c2944d2b037 reported cstate change: term changed from 0 to 1, leader changed from <none> to 017b870e998f41f5815e3c2944d2b037 (127.18.70.129). New cstate: current_term: 1 leader_uuid: "017b870e998f41f5815e3c2944d2b037" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eae4192f48c4793b63c40273f375c8c" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "017b870e998f41f5815e3c2944d2b037" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 41359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6cb144c21e34abdbe7d839f4ddd38b0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34219 } health_report { overall_health: UNKNOWN } } }
Aug 12 06:57:20 dist-test-slave-tc2s krb5kdc[19730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:57:20.148989 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:20.134622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54352 (local address 127.18.70.129:41359)
0812 06:57:20.134832 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:20.134839 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:20.135184 (+ 345us) server_negotiation.cc:407] Connection header received
0812 06:57:20.135352 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:20.135356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:20.135451 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:20.135540 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:20.137079 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.137804 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.139046 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.139466 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.139577 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:20.143505 (+ 3928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:20.143519 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:20.143534 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:20.143567 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:20.146277 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.146948 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.146956 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.146958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.147124 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.147501 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.147504 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.147506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.147851 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:20.148129 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:20.148433 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 06:57:20.148687 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 06:57:20 dist-test-slave-tc2s krb5kdc[19730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517840, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260812 06:57:20.270015 18714 mini_kdc.cc:317] Time spent kinit for test-user: real 0.118s user 0.001s sys 0.009s
Aug 12 06:57:20 dist-test-slave-tc2s krb5kdc[19730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517840, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:57:20.287133 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:20.272624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54358 (local address 127.18.70.129:41359)
0812 06:57:20.272808 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:20.272817 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:20.273221 (+ 404us) server_negotiation.cc:407] Connection header received
0812 06:57:20.273397 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:20.273402 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:20.273488 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:20.273575 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:20.274980 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.275806 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.277049 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.277493 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.277602 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:20.282052 (+ 4450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:20.282058 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:20.282062 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:20.282099 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:20.284566 (+ 2467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.285186 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.285191 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.285195 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.285335 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.285693 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.285698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.285701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.286005 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:20.286254 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:20.286530 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 06:57:20.286764 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 06:57:20 dist-test-slave-tc2s krb5kdc[19730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:57:20 dist-test-slave-tc2s krb5kdc[19730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:57:20.387761 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:20.373488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54374 (local address 127.18.70.129:41359)
0812 06:57:20.373665 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:20.373672 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:20.374101 (+ 429us) server_negotiation.cc:407] Connection header received
0812 06:57:20.374306 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:20.374310 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:20.374405 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:20.374505 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:20.375889 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.376632 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.377933 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.378356 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.378470 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:20.383055 (+ 4585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:20.383060 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:20.383064 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:20.383101 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:20.385512 (+ 2411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.386188 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.386191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.386193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.386348 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.386640 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.386643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.386645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.386893 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:20.387084 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:20.387341 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 06:57:20.387513 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260812 06:57:20.389571 20005 tablet_service.cc:2908] Rejecting scan request for tablet 78b79d3f0546461890a3b0d30c468aac: Uninitialized: clean time has not yet been initialized
I20260812 06:57:20.392859 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 19925
I20260812 06:57:20.404760 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:20.393656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54376 (local address 127.18.70.129:41359)
0812 06:57:20.393821 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:20.393825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:20.394143 (+ 318us) server_negotiation.cc:407] Connection header received
0812 06:57:20.394335 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:20.394339 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:20.394396 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:20.394471 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:20.395677 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.396367 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.397560 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.398021 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.398113 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:20.400140 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:20.400143 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:20.400146 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:20.400170 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:20.402747 (+ 2577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.403304 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.403308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.403310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.403411 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.403719 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.403722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.403724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.403974 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:20.404141 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:20.404362 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 06:57:20.404520 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 06:57:20.405392 20161 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:20.500757 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 19925
I20260812 06:57:20.522843 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 20184
Aug 12 06:57:20 dist-test-slave-tc2s krb5kdc[19730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 06:57:20.537664 20709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:20.523583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50882 (local address 127.18.70.130:34219)
0812 06:57:20.523740 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:20.523744 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:20.523779 (+ 35us) server_negotiation.cc:407] Connection header received
0812 06:57:20.523954 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:20.523958 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:20.524032 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:20.524114 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:20.525470 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.526630 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.528044 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.528444 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.528559 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:20.532567 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:20.532581 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:20.532599 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:20.532633 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:20.535189 (+ 2556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.535883 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.535890 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.535892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.536022 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.536326 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.536329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.536331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.536685 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:20.536959 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:20.537173 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 06:57:20.537340 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 06:57:20.538334 20414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:20.625809 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 20184
I20260812 06:57:20.649235 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 20434
Aug 12 06:57:20 dist-test-slave-tc2s krb5kdc[19730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 06:57:20.663738 20753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:20.650105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36098 (local address 127.18.70.131:46663)
0812 06:57:20.650628 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:20.650632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:20.650648 (+ 16us) server_negotiation.cc:407] Connection header received
0812 06:57:20.650705 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:20.650708 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:20.650771 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:20.650869 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:20.652132 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.652884 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.654323 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:20.654729 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:20.654842 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:20.658747 (+ 3905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:20.658761 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:20.658779 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:20.658813 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:20.661374 (+ 2561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.662019 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.662027 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.662030 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.662149 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:20.662459 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:20.662462 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:20.662464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:20.662796 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:20.663021 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:20.663230 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 06:57:20.663399 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":285,"threads_started":1}
I20260812 06:57:20.664685 20669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:20.751775 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 20434
W20260812 06:57:20.778290 19787 connection.cc:535] server connection from 127.18.70.131:58899 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:57:20.778616 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 19757
I20260812 06:57:20.779786 19867 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:20.891502 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 19757
2026-08-12T06:57:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4645 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:57:21 dist-test-slave-tc2s krb5kdc[20760](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:57:21 dist-test-slave-tc2s krb5kdc[20760](info): set up 2 sockets
Aug 12 06:57:21 dist-test-slave-tc2s krb5kdc[20760](info): commencing operation
krb5kdc: starting...
W20260812 06:57:22.990921 18714 mini_kdc.cc:121] Time spent starting KDC: real 2.049s user 0.007s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:57:23 dist-test-slave-tc2s krb5kdc[20760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:57:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:57:23.177284 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36573
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:42543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:36573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:23.506605 20784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:23.506887 20784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:23.506987 20784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:23.514263 20784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:23.514359 20784 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:57:23.514412 20784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:23.514472 20784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:23.514521 20784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:23.514581 20784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:57:23.524577 20784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:42543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:36573
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:23.525907 20784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:23.527235 20784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:23.538969 20796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:23.539058 20801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:23.539034 20797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:23.540081 20784 server_base.cc:1034] running on GCE node
I20260812 06:57:23.540951 20784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:23.542445 20784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:23.543664 20784 hybrid_clock.cc:648] HybridClock initialized: now 1786517843543604 us; error 38 us; skew 500 ppm
I20260812 06:57:23.543975 20784 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:23 dist-test-slave-tc2s krb5kdc[20760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517843, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:23.547061 20784 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:57:23.548420 20784 webserver.cc:460] Webserver started at http://127.18.70.190:39937/ using document root <none> and password file <none>
I20260812 06:57:23.549090 20784 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:23.549189 20784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:23.549507 20784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:23.552415 20784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "60b5d87617fb458ea8c77bb6aae8048b"
format_stamp: "Formatted at 2026-08-12 06:57:23 on dist-test-slave-tc2s"
server_key: "751c3bc3a1da454be6c770c8005ab4ea"
server_key_iv: "1b3894a8632cf79e847c8d9c6503fa5c"
server_key_version: "encryptionkey@0"
I20260812 06:57:23.553126 20784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "60b5d87617fb458ea8c77bb6aae8048b"
format_stamp: "Formatted at 2026-08-12 06:57:23 on dist-test-slave-tc2s"
server_key: "751c3bc3a1da454be6c770c8005ab4ea"
server_key_iv: "1b3894a8632cf79e847c8d9c6503fa5c"
server_key_version: "encryptionkey@0"
I20260812 06:57:23.558177 20784 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260812 06:57:23.561549 20818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:23.562809 20784 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:23.562968 20784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "60b5d87617fb458ea8c77bb6aae8048b"
format_stamp: "Formatted at 2026-08-12 06:57:23 on dist-test-slave-tc2s"
server_key: "751c3bc3a1da454be6c770c8005ab4ea"
server_key_iv: "1b3894a8632cf79e847c8d9c6503fa5c"
server_key_version: "encryptionkey@0"
I20260812 06:57:23.563164 20784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:23.573702 20784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:23.577558 20784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:23.577792 20784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:23.598759 20784 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:36573
I20260812 06:57:23.598766 20927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:36573 every 8 connection(s)
I20260812 06:57:23.600148 20784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:23.604094 20928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:23.604616 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 20784
I20260812 06:57:23.604851 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:23.605751 18714 external_mini_cluster.cc:1428] Setting key 5f3611e98bf06f61cced5ae22a709ec0
I20260812 06:57:23.617991 20928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b: Bootstrap starting.
Aug 12 06:57:23 dist-test-slave-tc2s krb5kdc[20760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:23.621924 20928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:23.622994 20928 log.cc:824] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:23.626286 20928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b: No bootstrap required, opened a new log
I20260812 06:57:23.629781 20934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:23.607855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52384 (local address 127.18.70.190:36573)
0812 06:57:23.608662 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:23.608677 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:23.608721 (+ 44us) server_negotiation.cc:407] Connection header received
0812 06:57:23.610498 (+ 1777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:23.610521 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:23.610896 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:23.611212 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:23.612917 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:23.614273 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:23.616109 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:23.616793 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:23.616927 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:23.621844 (+ 4917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:23.621854 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:23.621869 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:23.621948 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:23.625295 (+ 3347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:23.625974 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:23.625982 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:23.625990 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:23.626211 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:23.626578 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:23.626583 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:23.626586 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:23.627352 (+ 766us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:23.627631 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:23.627972 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 06:57:23.628430 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":356,"threads_started":1}
I20260812 06:57:23.635227 20928 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60b5d87617fb458ea8c77bb6aae8048b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36573 } }
I20260812 06:57:23.635568 20928 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:23.635681 20928 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60b5d87617fb458ea8c77bb6aae8048b, State: Initialized, Role: FOLLOWER
I20260812 06:57:23.636281 20928 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60b5d87617fb458ea8c77bb6aae8048b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36573 } }
I20260812 06:57:23.636571 20928 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:23.636685 20928 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:23.636816 20928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:23.639129 20928 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60b5d87617fb458ea8c77bb6aae8048b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36573 } }
I20260812 06:57:23.639642 20928 leader_election.cc:302] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60b5d87617fb458ea8c77bb6aae8048b; no voters:
I20260812 06:57:23.640183 20928 leader_election.cc:288] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:23.640355 20938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:23.641417 20938 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [term 1 LEADER]: Becoming Leader. State: Replica: 60b5d87617fb458ea8c77bb6aae8048b, State: Running, Role: LEADER
I20260812 06:57:23.642061 20938 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60b5d87617fb458ea8c77bb6aae8048b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36573 } }
I20260812 06:57:23.642344 20928 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:23.645040 20941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60b5d87617fb458ea8c77bb6aae8048b. Latest consensus state: current_term: 1 leader_uuid: "60b5d87617fb458ea8c77bb6aae8048b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60b5d87617fb458ea8c77bb6aae8048b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36573 } } }
I20260812 06:57:23.645012 20939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60b5d87617fb458ea8c77bb6aae8048b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60b5d87617fb458ea8c77bb6aae8048b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36573 } } }
I20260812 06:57:23.650058 20941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:23.650058 20939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:23.652643 20949 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:23.657917 20949 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:23.667052 20949 catalog_manager.cc:1347] Generated new cluster ID: c68c2ad9837f440294195eaf47ff746b
I20260812 06:57:23.667164 20949 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:23.706043 20949 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:23.707381 20949 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:23.713111 20949 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b: Generated new TSK 0
I20260812 06:57:23.713851 20949 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:57:23.774668 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36573
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:42543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:24.110997 20976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:24.111280 20976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:24.111393 20976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:24.118593 20976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:24.118701 20976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:24.118793 20976 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:57:24.118875 20976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:57:24.128652 20976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:42543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.70.190:36573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:24.129967 20976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:24.131422 20976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:24.144706 20993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:24.144806 20987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:24.144758 20989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:24.145620 20976 server_base.cc:1034] running on GCE node
I20260812 06:57:24.146342 20976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:24.147351 20976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:24.148577 20976 hybrid_clock.cc:648] HybridClock initialized: now 1786517844148512 us; error 35 us; skew 500 ppm
I20260812 06:57:24.148886 20976 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:24 dist-test-slave-tc2s krb5kdc[20760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517844, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:24.156948 20976 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:57:24.158735 20976 webserver.cc:460] Webserver started at http://127.18.70.129:34737/ using document root <none> and password file <none>
I20260812 06:57:24.159477 20976 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:24.159582 20976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:24.159915 20976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:24.163422 20976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2"
format_stamp: "Formatted at 2026-08-12 06:57:24 on dist-test-slave-tc2s"
server_key: "39ecf25e5a950be64b83512f3924a010"
server_key_iv: "e8a2aba7ce448b4cd16611356e577c66"
server_key_version: "encryptionkey@0"
I20260812 06:57:24.164211 20976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2"
format_stamp: "Formatted at 2026-08-12 06:57:24 on dist-test-slave-tc2s"
server_key: "39ecf25e5a950be64b83512f3924a010"
server_key_iv: "e8a2aba7ce448b4cd16611356e577c66"
server_key_version: "encryptionkey@0"
I20260812 06:57:24.169466 20976 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 06:57:24.172868 21009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:24.174340 20976 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:24.174499 20976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2"
format_stamp: "Formatted at 2026-08-12 06:57:24 on dist-test-slave-tc2s"
server_key: "39ecf25e5a950be64b83512f3924a010"
server_key_iv: "e8a2aba7ce448b4cd16611356e577c66"
server_key_version: "encryptionkey@0"
I20260812 06:57:24.174717 20976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:24.189543 20976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:24.193811 20976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:24.194100 20976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:24.197127 20976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:24.197212 20976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:24.197343 20976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:24.197407 20976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:57:24 dist-test-slave-tc2s krb5kdc[20760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517844, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:24.219849 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:24.197701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:43261 (local address 127.18.70.190:36573)
0812 06:57:24.198370 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:24.198378 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:24.199435 (+ 1057us) server_negotiation.cc:407] Connection header received
0812 06:57:24.201547 (+ 2112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:24.201553 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:24.201648 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:24.201777 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:24.203921 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.204912 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.207556 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.208171 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.208291 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:24.212425 (+ 4134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:24.212433 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:24.212439 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:24.212483 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:24.215735 (+ 3252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:24.216813 (+ 1078us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:24.216819 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:24.216823 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:24.216975 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:24.217542 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:24.217548 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:24.217552 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:24.218015 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:24.218176 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:24.219227 (+ 1051us) server_negotiation.cc:299] Negotiation successful
0812 06:57:24.219480 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":406,"threads_started":1}
I20260812 06:57:24.220920 21028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:24.198330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36573 (local address 127.18.70.129:43261)
0812 06:57:24.199240 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:24.199289 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:24.201230 (+ 1941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:24.202147 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:24.202161 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:24.202877 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:24.203728 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:24.203762 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.205085 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.205090 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:24.207253 (+ 2163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:24.207266 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.208486 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.208495 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:24.208677 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:24.209427 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:24.209449 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:24.212113 (+ 2664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:24.215892 (+ 3779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:24.215901 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:24.215921 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:24.216652 (+ 731us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:24.217087 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:24.217092 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:24.217097 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:24.217386 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:24.218192 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:24.218204 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:24.218725 (+ 521us) client_negotiation.cc:769] Sending connection context
0812 06:57:24.219117 (+ 392us) client_negotiation.cc:240] Negotiation successful
0812 06:57:24.219644 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":370,"threads_started":1}
I20260812 06:57:24.243578 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:24.228721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:44281 (local address 127.18.70.190:36573)
0812 06:57:24.228894 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:24.228899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:24.229463 (+ 564us) server_negotiation.cc:407] Connection header received
0812 06:57:24.229643 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:24.229649 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:24.229728 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:24.229842 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:24.231466 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.232363 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.234643 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.235102 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.235201 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:24.237630 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:24.237637 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:24.237642 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:24.237681 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:24.240539 (+ 2858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:24.241321 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:24.241327 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:24.241331 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:24.241470 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:24.241934 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:24.241940 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:24.241944 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:24.242331 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:24.242529 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:24.242980 (+ 451us) server_negotiation.cc:299] Negotiation successful
0812 06:57:24.243212 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 06:57:24.243736 21163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:24.228787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36573 (local address 127.18.70.129:44281)
0812 06:57:24.229363 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:24.229379 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:24.229520 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:24.229924 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:24.229932 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:24.230808 (+ 876us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:24.231292 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:24.231308 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.232535 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.232541 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:24.234482 (+ 1941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:24.234502 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.235295 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.235302 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:24.235471 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:24.236237 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:24.236263 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:24.237377 (+ 1114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:24.240669 (+ 3292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:24.240674 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:24.240769 (+ 95us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:24.241180 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:24.241590 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:24.241598 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:24.241602 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:24.241780 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:24.242461 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:24.242464 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:24.242673 (+ 209us) client_negotiation.cc:769] Sending connection context
0812 06:57:24.242839 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 06:57:24.243212 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":305,"threads_started":1}
I20260812 06:57:24.248483 20976 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:42427
I20260812 06:57:24.248503 21231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:42427 every 8 connection(s)
I20260812 06:57:24.249608 20976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:57:24.251421 21235 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36573
I20260812 06:57:24.251624 21235 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:24.252270 21235 heartbeater.cc:511] Master 127.18.70.190:36573 requested a full tablet report, sending...
I20260812 06:57:24.254194 20850 ts_manager.cc:194] Registered new tserver with Master: abe8f0bbe6414082bbb93c7dbd8aafc2 (127.18.70.129:42427)
I20260812 06:57:24.255607 20850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:43261
I20260812 06:57:24.256474 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 20976
I20260812 06:57:24.256706 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:57:24.257381 18714 external_mini_cluster.cc:1428] Setting key 13c6d87470bf21cc61a97b05130e8a3a
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 06:57:24.298548 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36573
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:42543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:24.632520 21241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:24.632810 21241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:24.632953 21241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:24.640379 21241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:24.640501 21241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:24.640614 21241 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:57:24.640717 21241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:57:24.650804 21241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:42543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.70.190:36573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:24.652235 21241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:24.653657 21241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:24.666602 21253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:24.666584 21256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:24.667037 21248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:24.668066 21241 server_base.cc:1034] running on GCE node
I20260812 06:57:24.668704 21241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:24.669642 21241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:24.670857 21241 hybrid_clock.cc:648] HybridClock initialized: now 1786517844670773 us; error 50 us; skew 500 ppm
I20260812 06:57:24.671141 21241 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:24 dist-test-slave-tc2s krb5kdc[20760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517844, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:24.674420 21241 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:57:24.675930 21241 webserver.cc:460] Webserver started at http://127.18.70.130:43843/ using document root <none> and password file <none>
I20260812 06:57:24.676635 21241 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:24.676739 21241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:24.677074 21241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:24.680217 21241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "f2bed424794e4961b297e34dcce182dd"
format_stamp: "Formatted at 2026-08-12 06:57:24 on dist-test-slave-tc2s"
server_key: "4196ea5809c4b7eec2b75e61e47addb5"
server_key_iv: "eecff78bda1e4c733177c2f53211cfd1"
server_key_version: "encryptionkey@0"
I20260812 06:57:24.681037 21241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "f2bed424794e4961b297e34dcce182dd"
format_stamp: "Formatted at 2026-08-12 06:57:24 on dist-test-slave-tc2s"
server_key: "4196ea5809c4b7eec2b75e61e47addb5"
server_key_iv: "eecff78bda1e4c733177c2f53211cfd1"
server_key_version: "encryptionkey@0"
I20260812 06:57:24.686339 21241 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 06:57:24.690001 21266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:24.691327 21241 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 06:57:24.691493 21241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "f2bed424794e4961b297e34dcce182dd"
format_stamp: "Formatted at 2026-08-12 06:57:24 on dist-test-slave-tc2s"
server_key: "4196ea5809c4b7eec2b75e61e47addb5"
server_key_iv: "eecff78bda1e4c733177c2f53211cfd1"
server_key_version: "encryptionkey@0"
I20260812 06:57:24.691716 21241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:24.717319 21241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:24.721570 21241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:24.721830 21241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:24.724913 21241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:24.725016 21241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:24.725174 21241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:24.725289 21241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 12 06:57:24 dist-test-slave-tc2s krb5kdc[20760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517844, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:24.747711 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:24.725356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:57781 (local address 127.18.70.190:36573)
0812 06:57:24.725523 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:24.725530 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:24.727145 (+ 1615us) server_negotiation.cc:407] Connection header received
0812 06:57:24.729250 (+ 2105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:24.729255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:24.729348 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:24.729452 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:24.731580 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.732365 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.733981 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.734568 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.734678 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:24.740012 (+ 5334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:24.740020 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:24.740026 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:24.740082 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:24.743741 (+ 3659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:24.744722 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:24.744733 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:24.744737 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:24.744930 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:24.745425 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:24.745430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:24.745434 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:24.745851 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:24.746046 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:24.747247 (+ 1201us) server_negotiation.cc:299] Negotiation successful
0812 06:57:24.747444 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 06:57:24.749724 21281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:24.726115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36573 (local address 127.18.70.130:57781)
0812 06:57:24.726978 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:24.727014 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:24.728970 (+ 1956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:24.729730 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:24.729745 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:24.730553 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:24.731400 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:24.731422 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.732517 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.732521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:24.733809 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:24.733823 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.735233 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.735243 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:24.735508 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:24.736261 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:24.736300 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:24.739636 (+ 3336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:24.743922 (+ 4286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:24.743933 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:24.743954 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:24.744575 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:24.745083 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:24.745087 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:24.745089 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:24.745312 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:24.746145 (+ 833us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:24.746156 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:24.746774 (+ 618us) client_negotiation.cc:769] Sending connection context
0812 06:57:24.747139 (+ 365us) client_negotiation.cc:240] Negotiation successful
0812 06:57:24.747789 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":387,"threads_started":1}
I20260812 06:57:24.772588 21400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:24.756736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36573 (local address 127.18.70.130:53617)
0812 06:57:24.757530 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:24.757550 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:24.757682 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:24.758026 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:24.758030 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:24.758738 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:24.759190 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:24.759212 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.760468 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.760474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:24.762035 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:24.762056 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.763179 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.763187 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:24.763414 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:24.764051 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:24.764078 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:24.765105 (+ 1027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:24.769143 (+ 4038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:24.769149 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:24.769158 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:24.769712 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:24.770180 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:24.770187 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:24.770191 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:24.770405 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:24.771091 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:24.771097 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:24.771359 (+ 262us) client_negotiation.cc:769] Sending connection context
0812 06:57:24.771558 (+ 199us) client_negotiation.cc:240] Negotiation successful
0812 06:57:24.771978 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":474,"threads_started":1}
I20260812 06:57:24.773533 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:24.756733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:53617 (local address 127.18.70.190:36573)
0812 06:57:24.756950 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:24.756956 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:24.757631 (+ 675us) server_negotiation.cc:407] Connection header received
0812 06:57:24.757795 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:24.757806 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:24.757878 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:24.757990 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:24.759337 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.760334 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.762242 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:24.762791 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:24.762926 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:24.765312 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:24.765320 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:24.765326 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:24.765380 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:24.769010 (+ 3630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:24.769874 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:24.769878 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:24.769881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:24.770058 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:24.770547 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:24.770552 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:24.770556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:24.770951 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:24.771104 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:24.772946 (+ 1842us) server_negotiation.cc:299] Negotiation successful
0812 06:57:24.773184 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 06:57:24.775949 21241 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:32993
I20260812 06:57:24.775971 21502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:32993 every 8 connection(s)
I20260812 06:57:24.777236 21241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:57:24.779327 21503 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36573
I20260812 06:57:24.779546 21503 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:24.780157 21503 heartbeater.cc:511] Master 127.18.70.190:36573 requested a full tablet report, sending...
I20260812 06:57:24.781498 20850 ts_manager.cc:194] Registered new tserver with Master: f2bed424794e4961b297e34dcce182dd (127.18.70.130:32993)
I20260812 06:57:24.782356 20850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:57781
I20260812 06:57:24.787032 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 21241
I20260812 06:57:24.787185 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:57:24.787653 18714 external_mini_cluster.cc:1428] Setting key 6bbcc07223ee9dc4e89d744bce50f79f
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 06:57:24.826892 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36573
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:42543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:25.155450 21508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:25.155753 21508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:25.155894 21508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:25.163209 21508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:25.163328 21508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:25.163470 21508 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:57:25.163584 21508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:57:25.173597 21508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:42543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.70.190:36573
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:25.174973 21508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:25.176384 21508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:25.189956 21521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:25.190003 21518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:25.190025 21515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:25.195649 21508 server_base.cc:1034] running on GCE node
I20260812 06:57:25.196432 21508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:25.197455 21508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:25.198673 21508 hybrid_clock.cc:648] HybridClock initialized: now 1786517845198601 us; error 46 us; skew 500 ppm
I20260812 06:57:25.198988 21508 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:25 dist-test-slave-tc2s krb5kdc[20760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517845, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:25.202153 21508 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:57:25.203693 21508 webserver.cc:460] Webserver started at http://127.18.70.131:40213/ using document root <none> and password file <none>
I20260812 06:57:25.204453 21508 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:25.204556 21508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:25.204869 21508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:25.207895 21508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "336d3eb2b20f4093b12102dcabf7cbf4"
format_stamp: "Formatted at 2026-08-12 06:57:25 on dist-test-slave-tc2s"
server_key: "628e9b6f70cfcc175c920ef3535ada01"
server_key_iv: "44315fed89492a42f26293bc2cf6fcc4"
server_key_version: "encryptionkey@0"
I20260812 06:57:25.208667 21508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "336d3eb2b20f4093b12102dcabf7cbf4"
format_stamp: "Formatted at 2026-08-12 06:57:25 on dist-test-slave-tc2s"
server_key: "628e9b6f70cfcc175c920ef3535ada01"
server_key_iv: "44315fed89492a42f26293bc2cf6fcc4"
server_key_version: "encryptionkey@0"
I20260812 06:57:25.213639 21508 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 06:57:25.217041 21533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:25.218318 21508 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:25.218472 21508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "336d3eb2b20f4093b12102dcabf7cbf4"
format_stamp: "Formatted at 2026-08-12 06:57:25 on dist-test-slave-tc2s"
server_key: "628e9b6f70cfcc175c920ef3535ada01"
server_key_iv: "44315fed89492a42f26293bc2cf6fcc4"
server_key_version: "encryptionkey@0"
I20260812 06:57:25.218673 21508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:25.231666 21508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:25.235551 21508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:25.235796 21508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:25.238422 21508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:25.238508 21508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:25.238651 21508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:25.238737 21508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:57:25 dist-test-slave-tc2s krb5kdc[20760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517845, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:25.258477 21235 heartbeater.cc:503] Master 127.18.70.190:36573 was elected leader, sending a full tablet report...
I20260812 06:57:25.262574 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.238969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:35495 (local address 127.18.70.190:36573)
0812 06:57:25.239175 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.239182 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.240504 (+ 1322us) server_negotiation.cc:407] Connection header received
0812 06:57:25.242697 (+ 2193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.242703 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.242796 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.242912 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:25.245315 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.246526 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.248760 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.249368 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.249505 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.254948 (+ 5443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:25.254956 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:25.254962 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:25.255008 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:25.258526 (+ 3518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:25.259549 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:25.259556 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:25.259560 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:25.259776 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:25.260388 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:25.260400 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:25.260402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:25.260704 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:25.260868 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.262001 (+ 1133us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.262264 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 06:57:25.263973 21554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.239411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36573 (local address 127.18.70.131:35495)
0812 06:57:25.240298 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:25.240348 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:25.242366 (+ 2018us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:25.243387 (+ 1021us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:25.243405 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:25.244292 (+ 887us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:25.245101 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.245134 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.246714 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.246720 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.248596 (+ 1876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.248613 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.249830 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.249838 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.250196 (+ 358us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.251028 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:25.251056 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:25.254635 (+ 3579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:25.258708 (+ 4073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:25.258718 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:25.258733 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:25.259352 (+ 619us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:25.259907 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:25.259912 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:25.259919 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:25.260202 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:25.260848 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:25.260860 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:25.261414 (+ 554us) client_negotiation.cc:769] Sending connection context
0812 06:57:25.261794 (+ 380us) client_negotiation.cc:240] Negotiation successful
0812 06:57:25.262425 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":346,"threads_started":1}
I20260812 06:57:25.283550 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.269435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:41945 (local address 127.18.70.190:36573)
0812 06:57:25.269616 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.269622 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.270124 (+ 502us) server_negotiation.cc:407] Connection header received
0812 06:57:25.270377 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.270384 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.270476 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.270595 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:25.272124 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.273026 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.275123 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.275609 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.275740 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.278112 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:25.278118 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:25.278122 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:25.278160 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:25.280770 (+ 2610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:25.281389 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:25.281394 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:25.281397 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:25.281525 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:25.281869 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:25.281872 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:25.281874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:25.282200 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:25.282342 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.282974 (+ 632us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.283181 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 06:57:25.283677 21681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.269389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36573 (local address 127.18.70.131:41945)
0812 06:57:25.270023 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:25.270044 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:25.270177 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:25.270775 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:25.270780 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:25.271463 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:25.271940 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.271958 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.273196 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.273202 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.274957 (+ 1755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.274977 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.275863 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.275871 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.276076 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.276704 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:25.276721 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:25.277806 (+ 1085us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:25.280890 (+ 3084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:25.280895 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:25.280899 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:25.281269 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:25.281628 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:25.281633 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:25.281637 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:25.281760 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:25.282414 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:25.282423 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:25.282680 (+ 257us) client_negotiation.cc:769] Sending connection context
0812 06:57:25.282831 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 06:57:25.283243 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":320,"threads_started":1}
I20260812 06:57:25.290493 21508 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:40523
I20260812 06:57:25.290557 21759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:40523 every 8 connection(s)
I20260812 06:57:25.291708 21508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:57:25.293493 21761 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36573
I20260812 06:57:25.293695 21761 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:25.294330 21761 heartbeater.cc:511] Master 127.18.70.190:36573 requested a full tablet report, sending...
I20260812 06:57:25.295401 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 21508
I20260812 06:57:25.295598 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:57:25.295614 20850 ts_manager.cc:194] Registered new tserver with Master: 336d3eb2b20f4093b12102dcabf7cbf4 (127.18.70.131:40523)
I20260812 06:57:25.296180 18714 external_mini_cluster.cc:1428] Setting key 48a4b1455ae5e63d76b824d97970f02b
I20260812 06:57:25.296656 20850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:35495
I20260812 06:57:25.298945 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:57:25 dist-test-slave-tc2s krb5kdc[20760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517845, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:57:25 dist-test-slave-tc2s krb5kdc[20760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517845, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:25.344348 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.330565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52392 (local address 127.18.70.190:36573)
0812 06:57:25.330800 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.330807 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.331119 (+ 312us) server_negotiation.cc:407] Connection header received
0812 06:57:25.331298 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.331303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.331377 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.331462 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:25.332804 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.333641 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.334902 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.335325 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.335438 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.339229 (+ 3791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:25.339234 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:25.339238 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:25.339271 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:25.341683 (+ 2412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:25.342341 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:25.342345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:25.342347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:25.342522 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:25.342919 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:25.342923 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:25.342925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:25.343186 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:25.343430 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.343790 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.344008 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 06:57:25.348038 20850 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:57:25.354763 20850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:57:25.378525 21803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.366150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43186 (local address 127.18.70.130:32993)
0812 06:57:25.370895 (+ 4745us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.370903 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.370930 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:57:25.371039 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.371046 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.371279 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.371444 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:25.372052 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.373436 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.376096 (+ 2660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.377197 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.377359 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.377554 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.377990 (+ 436us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.378147 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4579,"thread_start_us":4866,"threads_started":1}
I20260812 06:57:25.378551 21802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.365882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:32993 (local address 127.0.0.1:43186)
0812 06:57:25.366903 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:25.366960 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:25.367129 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:25.371472 (+ 4343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:25.371478 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:25.371512 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:25.371881 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.371892 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.373567 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.373572 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.375923 (+ 2351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.375948 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.377446 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.377455 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.377632 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.377700 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 06:57:25.377870 (+ 170us) client_negotiation.cc:240] Negotiation successful
0812 06:57:25.378062 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"mutex_wait_us":26,"thread_start_us":560,"threads_started":1}
I20260812 06:57:25.378646 21810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.366342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:40523 (local address 127.0.0.1:49444)
0812 06:57:25.367697 (+ 1355us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:25.367717 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:25.367831 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:25.372218 (+ 4387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:25.372222 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:25.372246 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:25.372609 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.372621 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.374600 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.374605 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.376244 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.376262 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.377721 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.377728 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.377880 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.377949 (+ 69us) client_negotiation.cc:769] Sending connection context
0812 06:57:25.378039 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 06:57:25.378161 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1228,"mutex_wait_us":19,"thread_start_us":5286,"threads_started":1}
I20260812 06:57:25.379343 21807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.366944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49444 (local address 127.18.70.131:40523)
0812 06:57:25.370911 (+ 3967us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.370920 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.370965 (+ 45us) server_negotiation.cc:407] Connection header received
0812 06:57:25.371068 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.371076 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.371303 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.372221 (+ 918us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:25.372836 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.374482 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.376393 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.377526 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.377642 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.377853 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.378866 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.379023 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3797,"thread_start_us":3614,"threads_started":1}
I20260812 06:57:25.380213 21806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.367195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:42427 (local address 127.0.0.1:54950)
0812 06:57:25.371910 (+ 4715us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:25.371929 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:25.372040 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:25.372581 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:25.372585 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:25.372606 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:25.372954 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.372966 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.374610 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.374616 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.376705 (+ 2089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.376719 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.379509 (+ 2790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.379515 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.379676 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.379706 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 06:57:25.379796 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 06:57:25.379910 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4608,"mutex_wait_us":18,"thread_start_us":674,"threads_started":1}
I20260812 06:57:25.380321 21814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.367698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54950 (local address 127.18.70.129:42427)
0812 06:57:25.370502 (+ 2804us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.370511 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.372027 (+ 1516us) server_negotiation.cc:407] Connection header received
0812 06:57:25.372172 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.372179 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.372385 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.372574 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:25.373116 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.374428 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.376871 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.379307 (+ 2436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.379456 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.379649 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.379862 (+ 213us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.380025 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2647,"thread_start_us":2497,"threads_started":1}
I20260812 06:57:25.382874 21631 tablet_service.cc:1467] Processing CreateTablet for tablet 57c0011544b3494ab26dc7848bdae043 (DEFAULT_TABLE table=test-table [id=53e8fc6850874b57b4ad62c74952152d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:25.382892 21373 tablet_service.cc:1467] Processing CreateTablet for tablet 57c0011544b3494ab26dc7848bdae043 (DEFAULT_TABLE table=test-table [id=53e8fc6850874b57b4ad62c74952152d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:25.384088 21631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c0011544b3494ab26dc7848bdae043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:25.383720 21107 tablet_service.cc:1467] Processing CreateTablet for tablet 57c0011544b3494ab26dc7848bdae043 (DEFAULT_TABLE table=test-table [id=53e8fc6850874b57b4ad62c74952152d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:25.384228 21373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c0011544b3494ab26dc7848bdae043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:25.384965 21107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57c0011544b3494ab26dc7848bdae043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:25.395578 21816 tablet_bootstrap.cc:492] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: Bootstrap starting.
I20260812 06:57:25.398067 21817 tablet_bootstrap.cc:492] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: Bootstrap starting.
I20260812 06:57:25.399040 21816 tablet_bootstrap.cc:654] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:25.399416 21820 tablet_bootstrap.cc:492] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: Bootstrap starting.
I20260812 06:57:25.400955 21816 log.cc:824] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:25.401499 21817 tablet_bootstrap.cc:654] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:25.402521 21820 tablet_bootstrap.cc:654] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:25.402666 21817 log.cc:824] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:25.403578 21820 log.cc:824] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:25.404130 21816 tablet_bootstrap.cc:492] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: No bootstrap required, opened a new log
I20260812 06:57:25.404443 21816 ts_tablet_manager.cc:1397] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260812 06:57:25.407164 21817 tablet_bootstrap.cc:492] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: No bootstrap required, opened a new log
I20260812 06:57:25.407437 21817 ts_tablet_manager.cc:1397] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260812 06:57:25.413031 21816 raft_consensus.cc:348] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } }
I20260812 06:57:25.413349 21816 raft_consensus.cc:374] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:25.413443 21816 raft_consensus.cc:729] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 336d3eb2b20f4093b12102dcabf7cbf4, State: Initialized, Role: FOLLOWER
I20260812 06:57:25.414038 21820 tablet_bootstrap.cc:492] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: No bootstrap required, opened a new log
I20260812 06:57:25.414088 21816 consensus_queue.cc:260] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } }
I20260812 06:57:25.414302 21820 ts_tablet_manager.cc:1397] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.002s
I20260812 06:57:25.415143 21761 heartbeater.cc:503] Master 127.18.70.190:36573 was elected leader, sending a full tablet report...
I20260812 06:57:25.415848 21816 ts_tablet_manager.cc:1428] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260812 06:57:25.416867 21817 raft_consensus.cc:348] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } }
I20260812 06:57:25.417269 21817 raft_consensus.cc:374] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:25.417378 21817 raft_consensus.cc:729] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2bed424794e4961b297e34dcce182dd, State: Initialized, Role: FOLLOWER
I20260812 06:57:25.417986 21817 consensus_queue.cc:260] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } }
I20260812 06:57:25.419034 21503 heartbeater.cc:503] Master 127.18.70.190:36573 was elected leader, sending a full tablet report...
I20260812 06:57:25.419626 21817 ts_tablet_manager.cc:1428] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260812 06:57:25.423126 21820 raft_consensus.cc:348] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } }
I20260812 06:57:25.423544 21820 raft_consensus.cc:374] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:25.423646 21820 raft_consensus.cc:729] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe8f0bbe6414082bbb93c7dbd8aafc2, State: Initialized, Role: FOLLOWER
I20260812 06:57:25.424167 21820 consensus_queue.cc:260] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } }
I20260812 06:57:25.425575 21820 ts_tablet_manager.cc:1428] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
W20260812 06:57:25.502343 21236 tablet.cc:2369] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:57:25.520598 21830 raft_consensus.cc:482] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:57:25.520938 21830 raft_consensus.cc:504] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } }
I20260812 06:57:25.522766 21830 leader_election.cc:288] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 336d3eb2b20f4093b12102dcabf7cbf4 (127.18.70.131:40523), abe8f0bbe6414082bbb93c7dbd8aafc2 (127.18.70.129:42427)
W20260812 06:57:25.529373 21504 tablet.cc:2369] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:57:25.531445 21840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.523070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:42427 (local address 127.18.70.130:42519)
0812 06:57:25.523934 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:25.523954 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:25.524115 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:25.524512 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:25.524517 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:25.524557 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:25.525167 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.525178 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.526594 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.526600 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.529194 (+ 2594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.529203 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.530813 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.530817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.530936 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.530962 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 06:57:25.531034 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:57:25.531126 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"mutex_wait_us":119,"spinlock_wait_cycles":3328,"thread_start_us":698,"threads_started":1}
I20260812 06:57:25.531453 21814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.523363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:42519 (local address 127.18.70.129:42427)
0812 06:57:25.523573 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.523579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.524062 (+ 483us) server_negotiation.cc:407] Connection header received
0812 06:57:25.524284 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.524306 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.524385 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.524480 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:25.525324 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.526445 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.529358 (+ 2913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.530587 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.530752 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.530826 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.531079 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.531213 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 06:57:25.532534 21837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.523152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:40523 (local address 127.18.70.130:59005)
0812 06:57:25.524067 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:25.524083 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:25.524198 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:25.524512 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:25.524517 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:25.524564 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:25.525142 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.525162 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.526595 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.526600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.529183 (+ 2583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.529201 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.531865 (+ 2664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.531871 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.532067 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.532100 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 06:57:25.532180 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:57:25.532268 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"mutex_wait_us":205,"spinlock_wait_cycles":13184,"thread_start_us":375,"threads_started":1}
I20260812 06:57:25.532616 21807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.523263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:59005 (local address 127.18.70.131:40523)
0812 06:57:25.523507 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.523515 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.524164 (+ 649us) server_negotiation.cc:407] Connection header received
0812 06:57:25.524309 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.524313 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.524385 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.524480 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:25.525314 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.526442 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.530309 (+ 3867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.531401 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.531567 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.531639 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.532238 (+ 599us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.532381 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 06:57:25.532615 21152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57c0011544b3494ab26dc7848bdae043" candidate_uuid: "f2bed424794e4961b297e34dcce182dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" is_pre_election: true
I20260812 06:57:25.533196 21152 raft_consensus.cc:2454] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2bed424794e4961b297e34dcce182dd in term 0.
I20260812 06:57:25.533434 21660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57c0011544b3494ab26dc7848bdae043" candidate_uuid: "f2bed424794e4961b297e34dcce182dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" is_pre_election: true
I20260812 06:57:25.533830 21271 leader_election.cc:302] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abe8f0bbe6414082bbb93c7dbd8aafc2, f2bed424794e4961b297e34dcce182dd; no voters:
I20260812 06:57:25.533944 21660 raft_consensus.cc:2454] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2bed424794e4961b297e34dcce182dd in term 0.
I20260812 06:57:25.534231 21830 raft_consensus.cc:2781] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:57:25.534396 21830 raft_consensus.cc:482] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:57:25.534519 21830 raft_consensus.cc:3037] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:25.536695 21830 raft_consensus.cc:504] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } }
I20260812 06:57:25.537374 21830 leader_election.cc:288] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [CANDIDATE]: Term 1 election: Requested vote from peers 336d3eb2b20f4093b12102dcabf7cbf4 (127.18.70.131:40523), abe8f0bbe6414082bbb93c7dbd8aafc2 (127.18.70.129:42427)
I20260812 06:57:25.537698 21660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57c0011544b3494ab26dc7848bdae043" candidate_uuid: "f2bed424794e4961b297e34dcce182dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "336d3eb2b20f4093b12102dcabf7cbf4"
I20260812 06:57:25.537926 21660 raft_consensus.cc:3037] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:25.537868 21152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57c0011544b3494ab26dc7848bdae043" candidate_uuid: "f2bed424794e4961b297e34dcce182dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2"
I20260812 06:57:25.538093 21152 raft_consensus.cc:3037] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:25.541160 21152 raft_consensus.cc:2454] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2bed424794e4961b297e34dcce182dd in term 1.
I20260812 06:57:25.541162 21660 raft_consensus.cc:2454] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2bed424794e4961b297e34dcce182dd in term 1.
I20260812 06:57:25.541592 21271 leader_election.cc:302] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 336d3eb2b20f4093b12102dcabf7cbf4, abe8f0bbe6414082bbb93c7dbd8aafc2, f2bed424794e4961b297e34dcce182dd; no voters:
I20260812 06:57:25.541954 21830 raft_consensus.cc:2781] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:25.542371 21830 raft_consensus.cc:686] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 1 LEADER]: Becoming Leader. State: Replica: f2bed424794e4961b297e34dcce182dd, State: Running, Role: LEADER
I20260812 06:57:25.542896 21830 consensus_queue.cc:237] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } }
W20260812 06:57:25.543179 21767 tablet.cc:2369] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:57:25.547422 20846 catalog_manager.cc:5495] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd reported cstate change: term changed from 0 to 1, leader changed from <none> to f2bed424794e4961b297e34dcce182dd (127.18.70.130). New cstate: current_term: 1 leader_uuid: "f2bed424794e4961b297e34dcce182dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } health_report { overall_health: UNKNOWN } } }
I20260812 06:57:25.575229 21803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.570341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43198 (local address 127.18.70.130:32993)
0812 06:57:25.570514 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.570518 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.570724 (+ 206us) server_negotiation.cc:407] Connection header received
0812 06:57:25.570980 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.570983 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.571056 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.571169 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:25.571477 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.572167 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.573403 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.573803 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.573913 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.574355 (+ 442us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:25.574803 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:25.574900 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.574974 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.575035 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:57:25.582510 21660 raft_consensus.cc:1261] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 1 FOLLOWER]: Refusing update from remote peer f2bed424794e4961b297e34dcce182dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:25.582522 21152 raft_consensus.cc:1261] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 FOLLOWER]: Refusing update from remote peer f2bed424794e4961b297e34dcce182dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:25.583345 21843 consensus_queue.cc:1035] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:25.583732 21830 consensus_queue.cc:1035] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:25.611740 20850 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:25.611990 20850 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:25.615286 20850 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b: Sending DeleteTablet for 3 replicas of tablet 57c0011544b3494ab26dc7848bdae043
I20260812 06:57:25.616282 21631 tablet_service.cc:1514] Processing DeleteTablet for tablet 57c0011544b3494ab26dc7848bdae043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:25 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:49444
I20260812 06:57:25.616369 21373 tablet_service.cc:1514] Processing DeleteTablet for tablet 57c0011544b3494ab26dc7848bdae043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:25 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:43186
I20260812 06:57:25.616922 21107 tablet_service.cc:1514] Processing DeleteTablet for tablet 57c0011544b3494ab26dc7848bdae043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:25 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:54950
I20260812 06:57:25.617982 20850 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:57:25.618672 20850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:57:25.621548 21872 tablet_replica.cc:330] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: stopping tablet replica
I20260812 06:57:25.622108 21872 raft_consensus.cc:2229] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:25.622707 21872 raft_consensus.cc:2258] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:25.625948 21872 ts_tablet_manager.cc:1905] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:25.626437 21876 tablet_replica.cc:330] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: stopping tablet replica
I20260812 06:57:25.626580 21873 tablet_replica.cc:330] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: stopping tablet replica
I20260812 06:57:25.626837 21876 raft_consensus.cc:2229] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:25.627383 21876 raft_consensus.cc:2258] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:25.627514 21369 tablet_service.cc:1467] Processing CreateTablet for tablet 0b89d7864d774ed98fc7f8828ce90cd4 (DEFAULT_TABLE table=test-table [id=2d534c9651d24a14a019ad2ccfcd2e66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:25.627775 21631 tablet_service.cc:1467] Processing CreateTablet for tablet 0b89d7864d774ed98fc7f8828ce90cd4 (DEFAULT_TABLE table=test-table [id=2d534c9651d24a14a019ad2ccfcd2e66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:25.628072 21369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b89d7864d774ed98fc7f8828ce90cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:25.628249 21631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b89d7864d774ed98fc7f8828ce90cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:25.630721 21107 tablet_service.cc:1467] Processing CreateTablet for tablet 0b89d7864d774ed98fc7f8828ce90cd4 (DEFAULT_TABLE table=test-table [id=2d534c9651d24a14a019ad2ccfcd2e66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:25.631157 21107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b89d7864d774ed98fc7f8828ce90cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:25.636050 21876 ts_tablet_manager.cc:1905] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:25.636960 21820 tablet_bootstrap.cc:492] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2: Bootstrap starting.
I20260812 06:57:25.638224 21817 tablet_bootstrap.cc:492] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd: Bootstrap starting.
I20260812 06:57:25.638594 21820 tablet_bootstrap.cc:654] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:25.638891 21872 ts_tablet_manager.cc:1918] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:57:25.639035 21872 log.cc:1196] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/57c0011544b3494ab26dc7848bdae043
I20260812 06:57:25.639891 21817 tablet_bootstrap.cc:654] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:25.640681 21872 ts_tablet_manager.cc:1939] T 57c0011544b3494ab26dc7848bdae043 P 336d3eb2b20f4093b12102dcabf7cbf4: Deleting consensus metadata
I20260812 06:57:25.626983 21873 raft_consensus.cc:2229] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:57:25.642573 20819 catalog_manager.cc:4841] TS 336d3eb2b20f4093b12102dcabf7cbf4 (127.18.70.131:40523): tablet 57c0011544b3494ab26dc7848bdae043 (table test-table [id=53e8fc6850874b57b4ad62c74952152d]) successfully deleted
I20260812 06:57:25.642678 21873 raft_consensus.cc:2258] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:25.644722 21816 tablet_bootstrap.cc:492] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4: Bootstrap starting.
I20260812 06:57:25.645323 21873 ts_tablet_manager.cc:1905] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:25.646353 21816 tablet_bootstrap.cc:654] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:25.648535 21816 tablet_bootstrap.cc:492] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4: No bootstrap required, opened a new log
I20260812 06:57:25.648733 21816 ts_tablet_manager.cc:1397] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 06:57:25.649569 21816 raft_consensus.cc:348] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.649808 21816 raft_consensus.cc:374] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:25.649969 21816 raft_consensus.cc:729] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 336d3eb2b20f4093b12102dcabf7cbf4, State: Initialized, Role: FOLLOWER
I20260812 06:57:25.650242 21816 consensus_queue.cc:260] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.650945 21816 ts_tablet_manager.cc:1428] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:57:25.645973 21817 tablet_bootstrap.cc:492] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd: No bootstrap required, opened a new log
I20260812 06:57:25.651351 21817 ts_tablet_manager.cc:1397] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.006s
I20260812 06:57:25.652251 21817 raft_consensus.cc:348] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.652486 21817 raft_consensus.cc:374] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:25.652587 21817 raft_consensus.cc:729] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2bed424794e4961b297e34dcce182dd, State: Initialized, Role: FOLLOWER
I20260812 06:57:25.652823 21817 consensus_queue.cc:260] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.653357 21817 ts_tablet_manager.cc:1428] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:57:25.658577 21820 tablet_bootstrap.cc:492] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2: No bootstrap required, opened a new log
I20260812 06:57:25.658733 21820 ts_tablet_manager.cc:1397] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.007s
I20260812 06:57:25.659040 21873 ts_tablet_manager.cc:1918] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:57:25.659183 21873 log.cc:1196] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/57c0011544b3494ab26dc7848bdae043
I20260812 06:57:25.659631 21873 ts_tablet_manager.cc:1939] T 57c0011544b3494ab26dc7848bdae043 P f2bed424794e4961b297e34dcce182dd: Deleting consensus metadata
I20260812 06:57:25.659521 21820 raft_consensus.cc:348] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.659729 21820 raft_consensus.cc:374] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:25.659832 21820 raft_consensus.cc:729] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe8f0bbe6414082bbb93c7dbd8aafc2, State: Initialized, Role: FOLLOWER
I20260812 06:57:25.660095 21820 consensus_queue.cc:260] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.660653 21820 ts_tablet_manager.cc:1428] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 06:57:25.661777 20826 catalog_manager.cc:4841] TS f2bed424794e4961b297e34dcce182dd (127.18.70.130:32993): tablet 57c0011544b3494ab26dc7848bdae043 (table test-table [id=53e8fc6850874b57b4ad62c74952152d]) successfully deleted
I20260812 06:57:25.661926 21876 ts_tablet_manager.cc:1918] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:57:25.662073 21876 log.cc:1196] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/57c0011544b3494ab26dc7848bdae043
I20260812 06:57:25.662634 21876 ts_tablet_manager.cc:1939] T 57c0011544b3494ab26dc7848bdae043 P abe8f0bbe6414082bbb93c7dbd8aafc2: Deleting consensus metadata
I20260812 06:57:25.664336 20826 catalog_manager.cc:4841] TS abe8f0bbe6414082bbb93c7dbd8aafc2 (127.18.70.129:42427): tablet 57c0011544b3494ab26dc7848bdae043 (table test-table [id=53e8fc6850874b57b4ad62c74952152d]) successfully deleted
I20260812 06:57:25.723075 21834 raft_consensus.cc:482] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:57:25.723310 21834 raft_consensus.cc:504] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.724972 21834 leader_election.cc:288] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2bed424794e4961b297e34dcce182dd (127.18.70.130:32993), 336d3eb2b20f4093b12102dcabf7cbf4 (127.18.70.131:40523)
I20260812 06:57:25.732061 21882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.725344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:40523 (local address 127.18.70.129:56815)
0812 06:57:25.726370 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:25.726385 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:25.726542 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:25.727009 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:25.727014 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:25.727036 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:25.727384 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.727395 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.728583 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.728588 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.730192 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.730206 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.731303 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.731310 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.731476 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.731511 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 06:57:25.731607 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 06:57:25.731733 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":922,"thread_start_us":396,"threads_started":1}
I20260812 06:57:25.732077 21807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.725405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:56815 (local address 127.18.70.131:40523)
0812 06:57:25.725588 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.725595 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.726464 (+ 869us) server_negotiation.cc:407] Connection header received
0812 06:57:25.726670 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.726676 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.726752 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.726835 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:25.727534 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.728373 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.730345 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.731087 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.731222 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.731298 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.731658 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.731800 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 06:57:25.733273 21660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b89d7864d774ed98fc7f8828ce90cd4" candidate_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" is_pre_election: true
I20260812 06:57:25.733542 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.725251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:32993 (local address 127.18.70.129:60799)
0812 06:57:25.726105 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:25.726125 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:25.726357 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:25.726726 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:25.726730 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:25.726754 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:25.727149 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.727161 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.729074 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.729079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.731263 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.731284 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.732767 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.732775 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.732967 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.733002 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 06:57:25.733098 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 06:57:25.733224 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":841,"threads_started":1}
I20260812 06:57:25.733536 21660 raft_consensus.cc:2454] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe8f0bbe6414082bbb93c7dbd8aafc2 in term 0.
I20260812 06:57:25.733585 21803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.725759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:60799 (local address 127.18.70.130:32993)
0812 06:57:25.725962 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.725968 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.726216 (+ 248us) server_negotiation.cc:407] Connection header received
0812 06:57:25.726520 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.726526 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.726608 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.726705 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:25.727328 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.728539 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.731432 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.732566 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.732684 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.732732 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.733146 (+ 414us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.733281 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 06:57:25.734323 21011 leader_election.cc:302] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 336d3eb2b20f4093b12102dcabf7cbf4, abe8f0bbe6414082bbb93c7dbd8aafc2; no voters:
I20260812 06:57:25.734666 21834 raft_consensus.cc:2781] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:57:25.734439 21417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b89d7864d774ed98fc7f8828ce90cd4" candidate_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2bed424794e4961b297e34dcce182dd" is_pre_election: true
I20260812 06:57:25.734772 21834 raft_consensus.cc:482] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:57:25.734865 21834 raft_consensus.cc:3037] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:25.734907 21417 raft_consensus.cc:2454] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe8f0bbe6414082bbb93c7dbd8aafc2 in term 0.
I20260812 06:57:25.737042 21834 raft_consensus.cc:504] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.737697 21834 leader_election.cc:288] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [CANDIDATE]: Term 1 election: Requested vote from peers f2bed424794e4961b297e34dcce182dd (127.18.70.130:32993), 336d3eb2b20f4093b12102dcabf7cbf4 (127.18.70.131:40523)
I20260812 06:57:25.738131 21417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b89d7864d774ed98fc7f8828ce90cd4" candidate_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2bed424794e4961b297e34dcce182dd"
I20260812 06:57:25.738256 21660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b89d7864d774ed98fc7f8828ce90cd4" candidate_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "336d3eb2b20f4093b12102dcabf7cbf4"
I20260812 06:57:25.738348 21417 raft_consensus.cc:3037] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:25.738444 21660 raft_consensus.cc:3037] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:25.741297 21660 raft_consensus.cc:2454] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe8f0bbe6414082bbb93c7dbd8aafc2 in term 1.
I20260812 06:57:25.741585 21417 raft_consensus.cc:2454] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe8f0bbe6414082bbb93c7dbd8aafc2 in term 1.
I20260812 06:57:25.741665 21011 leader_election.cc:302] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 336d3eb2b20f4093b12102dcabf7cbf4, abe8f0bbe6414082bbb93c7dbd8aafc2; no voters:
I20260812 06:57:25.742002 21834 raft_consensus.cc:2781] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:25.742457 21834 raft_consensus.cc:686] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 LEADER]: Becoming Leader. State: Replica: abe8f0bbe6414082bbb93c7dbd8aafc2, State: Running, Role: LEADER
I20260812 06:57:25.742996 21834 consensus_queue.cc:237] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.746393 20850 catalog_manager.cc:5495] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to abe8f0bbe6414082bbb93c7dbd8aafc2 (127.18.70.129). New cstate: current_term: 1 leader_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } health_report { overall_health: UNKNOWN } } }
Aug 12 06:57:25 dist-test-slave-tc2s krb5kdc[20760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517843, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:25.789269 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.776119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52404 (local address 127.18.70.190:36573)
0812 06:57:25.776291 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:25.776298 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:25.776855 (+ 557us) server_negotiation.cc:407] Connection header received
0812 06:57:25.777023 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:25.777027 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:25.777083 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:25.777159 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:25.778411 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.779270 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.780496 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.780952 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.781023 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.784253 (+ 3230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:25.784260 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:25.784265 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:25.784292 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:25.786678 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:25.787312 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:25.787317 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:25.787321 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:25.787470 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:25.787874 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:25.787879 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:25.787882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:25.788143 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:25.788270 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:25.788691 (+ 421us) server_negotiation.cc:299] Negotiation successful
0812 06:57:25.788979 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":94,"server-negotiator.queue_time_us":61}
I20260812 06:57:25.789307 21900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:25.776157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36573 (local address 127.0.0.1:52404)
0812 06:57:25.776763 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:25.776780 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:25.776918 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:25.777196 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:25.777201 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:25.777999 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:25.778265 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.778275 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.779381 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.779387 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.780351 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:25.780367 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:25.781201 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:25.781205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:25.781306 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:25.781961 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:25.781983 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:25.784082 (+ 2099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:25.786799 (+ 2717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:25.786812 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:25.786819 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:25.787192 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:25.787604 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:25.787608 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:25.787611 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:25.787768 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:25.788265 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:25.788272 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:25.788441 (+ 169us) client_negotiation.cc:769] Sending connection context
0812 06:57:25.788577 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 06:57:25.788841 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":324,"threads_started":1}
I20260812 06:57:25.794665 20850 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:52404:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:57:25.795712 20850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:57:25.802531 21107 tablet_service.cc:1467] Processing CreateTablet for tablet 6525ae4a195d4081ba5b0afd6b00b724 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=af56df45611742878e003f3e1947c9d8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:57:25.802791 21631 tablet_service.cc:1467] Processing CreateTablet for tablet 6525ae4a195d4081ba5b0afd6b00b724 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=af56df45611742878e003f3e1947c9d8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:57:25.803120 21107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6525ae4a195d4081ba5b0afd6b00b724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:25.803282 21631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6525ae4a195d4081ba5b0afd6b00b724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:25.810618 21369 tablet_service.cc:1467] Processing CreateTablet for tablet 6525ae4a195d4081ba5b0afd6b00b724 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=af56df45611742878e003f3e1947c9d8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:57:25.811092 21369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6525ae4a195d4081ba5b0afd6b00b724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:25.812460 21820 tablet_bootstrap.cc:492] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: Bootstrap starting.
I20260812 06:57:25.814168 21820 tablet_bootstrap.cc:654] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:25.815833 21816 tablet_bootstrap.cc:492] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4: Bootstrap starting.
I20260812 06:57:25.817013 21817 tablet_bootstrap.cc:492] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd: Bootstrap starting.
I20260812 06:57:25.817440 21816 tablet_bootstrap.cc:654] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:25.818518 21817 tablet_bootstrap.cc:654] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:25.819128 21820 tablet_bootstrap.cc:492] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: No bootstrap required, opened a new log
I20260812 06:57:25.819291 21820 ts_tablet_manager.cc:1397] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260812 06:57:25.820024 21820 raft_consensus.cc:348] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.820302 21820 raft_consensus.cc:374] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:25.820386 21820 raft_consensus.cc:729] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe8f0bbe6414082bbb93c7dbd8aafc2, State: Initialized, Role: FOLLOWER
I20260812 06:57:25.820607 21820 consensus_queue.cc:260] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.820914 21817 tablet_bootstrap.cc:492] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd: No bootstrap required, opened a new log
I20260812 06:57:25.821081 21817 ts_tablet_manager.cc:1397] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 06:57:25.821230 21820 ts_tablet_manager.cc:1428] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 06:57:25.821169 21834 tablet_replica.cc:439] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } }
I20260812 06:57:25.821447 21834 tablet_replica.cc:442] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:25.821838 21817 raft_consensus.cc:348] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.822100 21817 raft_consensus.cc:374] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:25.822184 21817 raft_consensus.cc:729] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2bed424794e4961b297e34dcce182dd, State: Initialized, Role: FOLLOWER
I20260812 06:57:25.822455 21817 consensus_queue.cc:260] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.823107 21830 tablet_replica.cc:439] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } }
I20260812 06:57:25.823410 21830 tablet_replica.cc:442] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:25.824028 21816 tablet_bootstrap.cc:492] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4: No bootstrap required, opened a new log
I20260812 06:57:25.824174 21816 ts_tablet_manager.cc:1397] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260812 06:57:25.824874 21817 ts_tablet_manager.cc:1428] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260812 06:57:25.824846 21816 raft_consensus.cc:348] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.825099 21816 raft_consensus.cc:374] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:25.825170 21816 raft_consensus.cc:729] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 336d3eb2b20f4093b12102dcabf7cbf4, State: Initialized, Role: FOLLOWER
I20260812 06:57:25.825390 21816 consensus_queue.cc:260] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:25.825824 21828 tablet_replica.cc:439] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } }
I20260812 06:57:25.826130 21828 tablet_replica.cc:442] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:25.826970 21816 ts_tablet_manager.cc:1428] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:57:26.012547 21834 raft_consensus.cc:482] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:57:26.012760 21834 raft_consensus.cc:504] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:26.013454 21834 leader_election.cc:288] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2bed424794e4961b297e34dcce182dd (127.18.70.130:32993), 336d3eb2b20f4093b12102dcabf7cbf4 (127.18.70.131:40523)
I20260812 06:57:26.014037 21660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6525ae4a195d4081ba5b0afd6b00b724" candidate_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" is_pre_election: true
I20260812 06:57:26.014055 21417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6525ae4a195d4081ba5b0afd6b00b724" candidate_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2bed424794e4961b297e34dcce182dd" is_pre_election: true
I20260812 06:57:26.014298 21660 raft_consensus.cc:2454] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe8f0bbe6414082bbb93c7dbd8aafc2 in term 0.
I20260812 06:57:26.014328 21417 raft_consensus.cc:2454] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe8f0bbe6414082bbb93c7dbd8aafc2 in term 0.
I20260812 06:57:26.014748 21011 leader_election.cc:302] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 336d3eb2b20f4093b12102dcabf7cbf4, abe8f0bbe6414082bbb93c7dbd8aafc2; no voters:
I20260812 06:57:26.015066 21834 raft_consensus.cc:2781] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:57:26.015164 21834 raft_consensus.cc:482] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:57:26.015275 21834 raft_consensus.cc:3037] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:26.017305 21834 raft_consensus.cc:504] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:26.017874 21834 leader_election.cc:288] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [CANDIDATE]: Term 1 election: Requested vote from peers f2bed424794e4961b297e34dcce182dd (127.18.70.130:32993), 336d3eb2b20f4093b12102dcabf7cbf4 (127.18.70.131:40523)
I20260812 06:57:26.018285 21417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6525ae4a195d4081ba5b0afd6b00b724" candidate_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2bed424794e4961b297e34dcce182dd"
I20260812 06:57:26.018392 21660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6525ae4a195d4081ba5b0afd6b00b724" candidate_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "336d3eb2b20f4093b12102dcabf7cbf4"
I20260812 06:57:26.018534 21417 raft_consensus.cc:3037] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:26.018599 21660 raft_consensus.cc:3037] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:26.021411 21660 raft_consensus.cc:2454] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe8f0bbe6414082bbb93c7dbd8aafc2 in term 1.
I20260812 06:57:26.021549 21417 raft_consensus.cc:2454] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe8f0bbe6414082bbb93c7dbd8aafc2 in term 1.
I20260812 06:57:26.021845 21011 leader_election.cc:302] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 336d3eb2b20f4093b12102dcabf7cbf4, abe8f0bbe6414082bbb93c7dbd8aafc2; no voters:
I20260812 06:57:26.022173 21834 raft_consensus.cc:2781] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:26.022351 21834 raft_consensus.cc:686] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 LEADER]: Becoming Leader. State: Replica: abe8f0bbe6414082bbb93c7dbd8aafc2, State: Running, Role: LEADER
I20260812 06:57:26.022622 21834 consensus_queue.cc:237] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } }
I20260812 06:57:26.025108 21887 tablet_replica.cc:439] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: TxnStatusTablet state changed. Reason: New leader abe8f0bbe6414082bbb93c7dbd8aafc2. Latest consensus state: current_term: 1 leader_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } }
I20260812 06:57:26.025463 21887 tablet_replica.cc:442] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:57:26.025966 20846 catalog_manager.cc:5495] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to abe8f0bbe6414082bbb93c7dbd8aafc2 (127.18.70.129). New cstate: current_term: 1 leader_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } health_report { overall_health: UNKNOWN } } }
I20260812 06:57:26.026283 21909 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:57:26.026588 21909 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:57:26.060737 21900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:26.054209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:42427 (local address 127.0.0.1:54958)
0812 06:57:26.054448 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:26.054471 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:26.054618 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:26.055668 (+ 1050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:26.055673 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:26.055686 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:57:26.055870 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:26.055879 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.057102 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.057108 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:26.058321 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:26.058334 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.059057 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.059063 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:26.059224 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:26.059285 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:57:26.060181 (+ 896us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:57:26.060212 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 06:57:26.060300 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 06:57:26.060460 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 06:57:26.060765 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:26.054227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54958 (local address 127.18.70.129:42427)
0812 06:57:26.055309 (+ 1082us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:26.055314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:26.055329 (+ 15us) server_negotiation.cc:407] Connection header received
0812 06:57:26.055400 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:26.055403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:26.055489 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:26.055618 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:26.056057 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.056924 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.058493 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.058901 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.059020 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:26.059506 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:26.060068 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:26.060195 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:26.060324 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 06:57:26.060406 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":979,"thread_start_us":830,"threads_started":1}
I20260812 06:57:26.065006 21660 raft_consensus.cc:1261] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 1 FOLLOWER]: Refusing update from remote peer abe8f0bbe6414082bbb93c7dbd8aafc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:26.065825 21417 raft_consensus.cc:1261] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd [term 1 FOLLOWER]: Refusing update from remote peer abe8f0bbe6414082bbb93c7dbd8aafc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:26.066376 21834 consensus_queue.cc:1035] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:26.067018 21834 consensus_queue.cc:1035] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:26.072289 21830 tablet_replica.cc:439] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd: TxnStatusTablet state changed. Reason: New leader abe8f0bbe6414082bbb93c7dbd8aafc2. Latest consensus state: current_term: 1 leader_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } }
I20260812 06:57:26.072541 21830 tablet_replica.cc:442] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:26.073520 21828 tablet_replica.cc:439] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4: TxnStatusTablet state changed. Reason: New leader abe8f0bbe6414082bbb93c7dbd8aafc2. Latest consensus state: current_term: 1 leader_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } }
I20260812 06:57:26.073798 21828 tablet_replica.cc:442] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:26.074533 21850 mvcc.cc:205] Tried to move back new op lower bound from 7317577097475063808 to 7317577097311850496. Current Snapshot: MvccSnapshot[applied={T|T < 7317577097475063808}]
I20260812 06:57:26.075124 21848 mvcc.cc:205] Tried to move back new op lower bound from 7317577097475063808 to 7317577097311850496. Current Snapshot: MvccSnapshot[applied={T|T < 7317577097475063808}]
I20260812 06:57:26.075435 21830 tablet_replica.cc:439] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } }
I20260812 06:57:26.075682 21830 tablet_replica.cc:442] T 6525ae4a195d4081ba5b0afd6b00b724 P f2bed424794e4961b297e34dcce182dd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:26.076085 21828 tablet_replica.cc:439] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } }
I20260812 06:57:26.076294 21828 tablet_replica.cc:442] T 6525ae4a195d4081ba5b0afd6b00b724 P 336d3eb2b20f4093b12102dcabf7cbf4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:26.079981 21887 tablet_replica.cc:439] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } }
I20260812 06:57:26.080209 21887 tablet_replica.cc:442] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:57:26.080972 21834 tablet_replica.cc:439] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe8f0bbe6414082bbb93c7dbd8aafc2" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 42427 } } peers { permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 } } peers { permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 } } }
I20260812 06:57:26.081276 21834 tablet_replica.cc:442] T 6525ae4a195d4081ba5b0afd6b00b724 P abe8f0bbe6414082bbb93c7dbd8aafc2: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:57:26.091799 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:26.086668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54966 (local address 127.18.70.129:42427)
0812 06:57:26.086818 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:26.086825 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:26.087195 (+ 370us) server_negotiation.cc:407] Connection header received
0812 06:57:26.087359 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:26.087364 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:26.087432 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:26.087509 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:26.087948 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.088738 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.090172 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.090609 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.090719 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:26.091116 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:26.091217 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:26.091295 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:26.091433 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 06:57:26.091510 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:57:26.108283 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:26.102753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:34859 (local address 127.18.70.129:42427)
0812 06:57:26.102909 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:26.102922 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:26.103572 (+ 650us) server_negotiation.cc:407] Connection header received
0812 06:57:26.103754 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:26.103759 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:26.103815 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:26.103895 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:26.104395 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.105131 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.106630 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.107045 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.107150 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:26.107580 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:26.107672 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:26.107742 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:26.107862 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 06:57:26.107939 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":46}
I20260812 06:57:26.108366 21927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:26.102878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:42427 (local address 127.18.70.129:34859)
0812 06:57:26.103482 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:26.103497 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:26.103620 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:26.103922 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:26.103927 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:26.103938 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:57:26.104250 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:26.104258 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.105255 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.105259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:26.106508 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:26.106520 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.107225 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.107230 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:26.107361 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:26.107413 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:57:26.107763 (+ 350us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:57:26.107772 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:57:26.107837 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:57:26.107971 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":325,"threads_started":1}
I20260812 06:57:26.117956 21417 raft_consensus.cc:1261] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd [term 1 FOLLOWER]: Refusing update from remote peer abe8f0bbe6414082bbb93c7dbd8aafc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:26.118005 21659 raft_consensus.cc:1261] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 1 FOLLOWER]: Refusing update from remote peer abe8f0bbe6414082bbb93c7dbd8aafc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:26.118484 21887 consensus_queue.cc:1035] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2bed424794e4961b297e34dcce182dd" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 32993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:26.118814 21917 consensus_queue.cc:1035] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "336d3eb2b20f4093b12102dcabf7cbf4" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 40523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:26.174822 20846 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:26.175046 20846 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:26.177772 20846 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 60b5d87617fb458ea8c77bb6aae8048b: Sending DeleteTablet for 3 replicas of tablet 0b89d7864d774ed98fc7f8828ce90cd4
I20260812 06:57:26.178632 21369 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b89d7864d774ed98fc7f8828ce90cd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:26 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:43186
I20260812 06:57:26.178678 21631 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b89d7864d774ed98fc7f8828ce90cd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:26 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:49444
I20260812 06:57:26.179045 21107 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b89d7864d774ed98fc7f8828ce90cd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:26 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:54950
I20260812 06:57:26.189203 21940 tablet_replica.cc:330] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2: stopping tablet replica
I20260812 06:57:26.190380 21940 raft_consensus.cc:2229] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:57:26.191246 21940 raft_consensus.cc:2258] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:26.193922 21940 ts_tablet_manager.cc:1905] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:26.194909 21935 tablet_replica.cc:330] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd: stopping tablet replica
I20260812 06:57:26.195530 21935 raft_consensus.cc:2229] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:26.195861 21937 tablet_replica.cc:330] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4: stopping tablet replica
I20260812 06:57:26.195892 21935 raft_consensus.cc:2258] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:26.196125 21937 raft_consensus.cc:2229] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:26.196414 21937 raft_consensus.cc:2258] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:26.197345 21935 ts_tablet_manager.cc:1905] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:26.198141 21937 ts_tablet_manager.cc:1905] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:26.204798 21940 ts_tablet_manager.cc:1918] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:57:26.205029 21940 log.cc:1196] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/0b89d7864d774ed98fc7f8828ce90cd4
I20260812 06:57:26.205590 21940 ts_tablet_manager.cc:1939] T 0b89d7864d774ed98fc7f8828ce90cd4 P abe8f0bbe6414082bbb93c7dbd8aafc2: Deleting consensus metadata
I20260812 06:57:26.206933 20826 catalog_manager.cc:4841] TS abe8f0bbe6414082bbb93c7dbd8aafc2 (127.18.70.129:42427): tablet 0b89d7864d774ed98fc7f8828ce90cd4 (table test-table [id=2d534c9651d24a14a019ad2ccfcd2e66]) successfully deleted
I20260812 06:57:26.207536 21935 ts_tablet_manager.cc:1918] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:57:26.207703 21935 log.cc:1196] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/0b89d7864d774ed98fc7f8828ce90cd4
I20260812 06:57:26.208190 21935 ts_tablet_manager.cc:1939] T 0b89d7864d774ed98fc7f8828ce90cd4 P f2bed424794e4961b297e34dcce182dd: Deleting consensus metadata
I20260812 06:57:26.209244 20826 catalog_manager.cc:4841] TS f2bed424794e4961b297e34dcce182dd (127.18.70.130:32993): tablet 0b89d7864d774ed98fc7f8828ce90cd4 (table test-table [id=2d534c9651d24a14a019ad2ccfcd2e66]) successfully deleted
I20260812 06:57:26.211849 21937 ts_tablet_manager.cc:1918] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:57:26.211987 21937 log.cc:1196] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/0b89d7864d774ed98fc7f8828ce90cd4
I20260812 06:57:26.212441 21937 ts_tablet_manager.cc:1939] T 0b89d7864d774ed98fc7f8828ce90cd4 P 336d3eb2b20f4093b12102dcabf7cbf4: Deleting consensus metadata
I20260812 06:57:26.213438 20819 catalog_manager.cc:4841] TS 336d3eb2b20f4093b12102dcabf7cbf4 (127.18.70.131:40523): tablet 0b89d7864d774ed98fc7f8828ce90cd4 (table test-table [id=2d534c9651d24a14a019ad2ccfcd2e66]) successfully deleted
Aug 12 06:57:26 dist-test-slave-tc2s krb5kdc[20760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517845, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:57:26.222687 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:26.195917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54972 (local address 127.18.70.129:42427)
0812 06:57:26.196110 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:26.196117 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:26.207252 (+ 11135us) server_negotiation.cc:407] Connection header received
0812 06:57:26.207541 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:26.207547 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:26.207657 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:26.207741 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:26.209838 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.210671 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.211924 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.212496 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.212624 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:26.216753 (+ 4129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:26.216767 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:26.216783 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:26.216818 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:26.219845 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:26.220499 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:26.220507 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:26.220509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:26.220664 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:26.221026 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:26.221030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:26.221032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:26.221371 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:26.221713 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:26.221999 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 06:57:26.222241 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 06:57:26.223440 21222 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54972
I20260812 06:57:26.239137 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:26.226074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52412 (local address 127.18.70.190:36573)
0812 06:57:26.226270 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:26.226277 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:26.226452 (+ 175us) server_negotiation.cc:407] Connection header received
0812 06:57:26.226575 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:26.226581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:26.226667 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:26.226773 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:26.228006 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.229159 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.230374 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.230939 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.231064 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:26.233176 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:26.233183 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:26.233188 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:26.233229 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:26.236634 (+ 3405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:26.237211 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:26.237216 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:26.237220 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:26.237374 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:26.237657 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:26.237662 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:26.237666 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:26.238066 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:26.238339 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:26.238549 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 06:57:26.238776 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260812 06:57:26.239673 20846 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52412
I20260812 06:57:26.241576 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 20976
I20260812 06:57:26.261164 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:26.242745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54976 (local address 127.18.70.129:42427)
0812 06:57:26.242942 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:26.242948 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:26.246347 (+ 3399us) server_negotiation.cc:407] Connection header received
0812 06:57:26.246521 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:26.246524 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:26.246590 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:26.246668 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:26.248140 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.249290 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.251052 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.251831 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.251944 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:26.254629 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:26.254637 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:26.254642 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:26.254683 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:26.258280 (+ 3597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:26.259075 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:26.259081 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:26.259084 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:26.259276 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:26.259657 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:26.259662 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:26.259665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:26.260012 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:26.260267 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:26.260585 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 06:57:26.260801 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 06:57:26.261724 21222 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54976
W20260812 06:57:26.262288 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 20976: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 06:57:26.262503 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 20976
I20260812 06:57:26.290254 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 21241
Aug 12 06:57:26 dist-test-slave-tc2s krb5kdc[20760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517845, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 06:57:26.306201 21952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:26.290988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43202 (local address 127.18.70.130:32993)
0812 06:57:26.291461 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:26.291465 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:26.291481 (+ 16us) server_negotiation.cc:407] Connection header received
0812 06:57:26.291535 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:26.291539 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:26.291601 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:26.291685 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:26.293121 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.293814 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.295746 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.296153 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.296251 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:26.300924 (+ 4673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:26.300937 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:26.300950 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:26.300989 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:26.303684 (+ 2695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:26.304426 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:26.304432 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:26.304434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:26.304559 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:26.304895 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:26.304898 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:26.304900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:26.305214 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:26.305452 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:26.305738 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 06:57:26.305943 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":261,"threads_started":1}
W20260812 06:57:26.306802 21495 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43202
W20260812 06:57:26.307412 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 21241: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 06:57:26.307540 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 21241
I20260812 06:57:26.341383 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 21508
Aug 12 06:57:26 dist-test-slave-tc2s krb5kdc[20760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517845, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 06:57:26.355926 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:26.342098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49454 (local address 127.18.70.131:40523)
0812 06:57:26.342572 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:26.342595 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:26.342616 (+ 21us) server_negotiation.cc:407] Connection header received
0812 06:57:26.342681 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:26.342685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:26.342749 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:26.342869 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:26.344118 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.344821 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.346121 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:26.346545 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:26.346662 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:26.350596 (+ 3934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:26.350610 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:26.350629 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:26.350660 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:26.353255 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:26.353939 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:26.353950 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:26.353954 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:26.354091 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:26.354459 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:26.354465 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:26.354467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:26.354791 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:26.355113 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:26.355376 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 06:57:26.355607 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":235,"threads_started":1}
W20260812 06:57:26.356580 21753 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49454
W20260812 06:57:26.357191 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 21508: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 06:57:26.357360 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 21508
I20260812 06:57:26.381172 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 20784
I20260812 06:57:26.382382 20921 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:26.504241 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 20784
2026-08-12T06:57:26Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5606 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:57:26 dist-test-slave-tc2s krb5kdc[21964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:57:26 dist-test-slave-tc2s krb5kdc[21964](info): set up 2 sockets
Aug 12 06:57:26 dist-test-slave-tc2s krb5kdc[21964](info): commencing operation
krb5kdc: starting...
W20260812 06:57:27.732892 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.000s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:57:27 dist-test-slave-tc2s krb5kdc[21964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:57:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:57:27.903225 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43433
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:39095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:43433
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:28.227296 21996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:28.227576 21996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:28.227708 21996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:28.234592 21996 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:28.234696 21996 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:57:28.234764 21996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:28.234845 21996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:28.234916 21996 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:28.234999 21996 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:57:28.244374 21996 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:39095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:43433
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:28.245550 21996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:28.246838 21996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:28.257819 22007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:28.257862 22013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:28.257921 22010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:28.258816 21996 server_base.cc:1034] running on GCE node
I20260812 06:57:28.259495 21996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:28.260740 21996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:28.261978 21996 hybrid_clock.cc:648] HybridClock initialized: now 1786517848261920 us; error 35 us; skew 500 ppm
I20260812 06:57:28.262270 21996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:28 dist-test-slave-tc2s krb5kdc[21964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517848, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:28.265089 21996 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:57:28.266396 21996 webserver.cc:460] Webserver started at http://127.18.70.190:37915/ using document root <none> and password file <none>
I20260812 06:57:28.267025 21996 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:28.267120 21996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:28.267407 21996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:28.270186 21996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "835f02cc4cce49fbb593cba252828619"
format_stamp: "Formatted at 2026-08-12 06:57:28 on dist-test-slave-tc2s"
server_key: "0c5aff247a62948e73f11defd5b0d1a7"
server_key_iv: "9d2f96db5307add3d56e4ddb909932cb"
server_key_version: "encryptionkey@0"
I20260812 06:57:28.270907 21996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "835f02cc4cce49fbb593cba252828619"
format_stamp: "Formatted at 2026-08-12 06:57:28 on dist-test-slave-tc2s"
server_key: "0c5aff247a62948e73f11defd5b0d1a7"
server_key_iv: "9d2f96db5307add3d56e4ddb909932cb"
server_key_version: "encryptionkey@0"
I20260812 06:57:28.275646 21996 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 06:57:28.278828 22030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:28.280004 21996 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 06:57:28.280145 21996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "835f02cc4cce49fbb593cba252828619"
format_stamp: "Formatted at 2026-08-12 06:57:28 on dist-test-slave-tc2s"
server_key: "0c5aff247a62948e73f11defd5b0d1a7"
server_key_iv: "9d2f96db5307add3d56e4ddb909932cb"
server_key_version: "encryptionkey@0"
I20260812 06:57:28.280341 21996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:28.298938 21996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:28.302425 21996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:28.302655 21996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:28.321725 21996 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:43433
I20260812 06:57:28.321759 22154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:43433 every 8 connection(s)
I20260812 06:57:28.322943 21996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:28.326366 22156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:28.330267 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 21996
I20260812 06:57:28.330515 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:28.331288 18714 external_mini_cluster.cc:1428] Setting key 2670d50e5048bea459db37c5ff9afb8d
I20260812 06:57:28.337533 22156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619: Bootstrap starting.
I20260812 06:57:28.340966 22156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:28.342096 22156 log.cc:824] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:28.344547 22156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619: No bootstrap required, opened a new log
Aug 12 06:57:28 dist-test-slave-tc2s krb5kdc[21964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:28.354307 22164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:28.333195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37928 (local address 127.18.70.190:43433)
0812 06:57:28.333922 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:28.333936 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:28.333978 (+ 42us) server_negotiation.cc:407] Connection header received
0812 06:57:28.336078 (+ 2100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:28.336099 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:28.336433 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:28.336726 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:28.338455 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:28.339734 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:28.341442 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:28.342148 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:28.342328 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:28.346217 (+ 3889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:28.346231 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:28.346249 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:28.346296 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:28.350163 (+ 3867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:28.350785 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:28.350793 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:28.350801 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:28.351001 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:28.351321 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:28.351326 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:28.351330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:28.352017 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:28.352319 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:28.352599 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 06:57:28.353015 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":320,"threads_started":1}
I20260812 06:57:28.354491 22156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835f02cc4cce49fbb593cba252828619" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43433 } }
I20260812 06:57:28.354872 22156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:28.354981 22156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 835f02cc4cce49fbb593cba252828619, State: Initialized, Role: FOLLOWER
I20260812 06:57:28.355551 22156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835f02cc4cce49fbb593cba252828619" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43433 } }
I20260812 06:57:28.355788 22156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:28.355921 22156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:28.356087 22156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:28.358189 22156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835f02cc4cce49fbb593cba252828619" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43433 } }
I20260812 06:57:28.358623 22156 leader_election.cc:302] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 835f02cc4cce49fbb593cba252828619; no voters:
I20260812 06:57:28.359117 22156 leader_election.cc:288] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:28.359258 22167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:28.359874 22167 raft_consensus.cc:686] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [term 1 LEADER]: Becoming Leader. State: Replica: 835f02cc4cce49fbb593cba252828619, State: Running, Role: LEADER
I20260812 06:57:28.360428 22167 consensus_queue.cc:237] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835f02cc4cce49fbb593cba252828619" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43433 } }
I20260812 06:57:28.361222 22156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:28.363147 22170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 835f02cc4cce49fbb593cba252828619. Latest consensus state: current_term: 1 leader_uuid: "835f02cc4cce49fbb593cba252828619" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835f02cc4cce49fbb593cba252828619" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43433 } } }
I20260812 06:57:28.363620 22170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:28.363157 22169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "835f02cc4cce49fbb593cba252828619" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835f02cc4cce49fbb593cba252828619" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43433 } } }
I20260812 06:57:28.364023 22169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:28.365188 22174 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:28.370625 22174 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:28.379530 22174 catalog_manager.cc:1347] Generated new cluster ID: 70a15bc40faa456aa660cdb94c0335a0
I20260812 06:57:28.379626 22174 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:28.411370 22174 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:28.413137 22174 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:28.422416 22174 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619: Generated new TSK 0
I20260812 06:57:28.423173 22174 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:57:28.482410 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43433
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:39095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:28.863476 22200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:28.863718 22200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:28.863850 22200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:28.870927 22200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:28.871026 22200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:28.871146 22200 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:57:28.871213 22200 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:57:28.871305 22200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:57:28.881381 22200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:39095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.70.190:43433
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:28.882583 22200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:28.883922 22200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:28.896318 22208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:28.896216 22210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:28.896144 22212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:28.897111 22200 server_base.cc:1034] running on GCE node
I20260812 06:57:28.897709 22200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:28.898593 22200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:28.899776 22200 hybrid_clock.cc:648] HybridClock initialized: now 1786517848899726 us; error 44 us; skew 500 ppm
I20260812 06:57:28.900053 22200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:28 dist-test-slave-tc2s krb5kdc[21964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517848, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:28.902978 22200 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:57:28.904322 22200 webserver.cc:460] Webserver started at http://127.18.70.129:45791/ using document root <none> and password file <none>
I20260812 06:57:28.904924 22200 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:28.905050 22200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:28.905342 22200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:28.908123 22200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "a4df4de6e6aa4604887d506e58f9352e"
format_stamp: "Formatted at 2026-08-12 06:57:28 on dist-test-slave-tc2s"
server_key: "917a37ea62e954b79a9e64ec0cb96e36"
server_key_iv: "00e6de31b73abc05345cdea30388ed7a"
server_key_version: "encryptionkey@0"
I20260812 06:57:28.908895 22200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "a4df4de6e6aa4604887d506e58f9352e"
format_stamp: "Formatted at 2026-08-12 06:57:28 on dist-test-slave-tc2s"
server_key: "917a37ea62e954b79a9e64ec0cb96e36"
server_key_iv: "00e6de31b73abc05345cdea30388ed7a"
server_key_version: "encryptionkey@0"
I20260812 06:57:28.913725 22200 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 06:57:28.916872 22228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:28.918102 22200 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:57:28.918244 22200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "a4df4de6e6aa4604887d506e58f9352e"
format_stamp: "Formatted at 2026-08-12 06:57:28 on dist-test-slave-tc2s"
server_key: "917a37ea62e954b79a9e64ec0cb96e36"
server_key_iv: "00e6de31b73abc05345cdea30388ed7a"
server_key_version: "encryptionkey@0"
I20260812 06:57:28.918413 22200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:28.940963 22200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:28.944561 22200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:28.944809 22200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:28.947528 22200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:28.947647 22200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:28.947805 22200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:28.947896 22200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:57:28 dist-test-slave-tc2s krb5kdc[21964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517848, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:28.968324 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:28.947943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:43413 (local address 127.18.70.190:43433)
0812 06:57:28.948401 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:28.948408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:28.949509 (+ 1101us) server_negotiation.cc:407] Connection header received
0812 06:57:28.951453 (+ 1944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:28.951459 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:28.951543 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:28.951638 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:28.953608 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:28.954610 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:28.957097 (+ 2487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:28.957733 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:28.957882 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:28.962470 (+ 4588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:28.962477 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:28.962482 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:28.962515 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:28.964816 (+ 2301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:28.965801 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:28.965807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:28.965812 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:28.966001 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:28.966506 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:28.966512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:28.966516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:28.966918 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:28.967081 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:28.967691 (+ 610us) server_negotiation.cc:299] Negotiation successful
0812 06:57:28.967940 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":232,"threads_started":1}
I20260812 06:57:28.968979 22261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:28.948605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43433 (local address 127.18.70.129:43413)
0812 06:57:28.949336 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:28.949400 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:28.951181 (+ 1781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:28.951866 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:28.951873 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:28.952592 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:28.953419 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:28.953454 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:28.954772 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:28.954781 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:28.956881 (+ 2100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:28.956900 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:28.958012 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:28.958020 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:28.958265 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:28.959057 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:28.959089 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:28.962201 (+ 3112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:28.964965 (+ 2764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:28.964975 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:28.964991 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:28.965611 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:28.966111 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:28.966116 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:28.966120 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:28.966380 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:28.967040 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:28.967046 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:28.967342 (+ 296us) client_negotiation.cc:769] Sending connection context
0812 06:57:28.967563 (+ 221us) client_negotiation.cc:240] Negotiation successful
0812 06:57:28.967904 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":302,"threads_started":1}
I20260812 06:57:28.991313 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:28.975300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:56675 (local address 127.18.70.190:43433)
0812 06:57:28.975468 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:28.975474 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:28.976267 (+ 793us) server_negotiation.cc:407] Connection header received
0812 06:57:28.976430 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:28.976435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:28.976524 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:28.976618 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:28.978207 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:28.979242 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:28.981475 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:28.982143 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:28.982274 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:28.984912 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:28.984919 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:28.984923 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:28.984970 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:28.987949 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:28.988883 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:28.988888 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:28.988892 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:28.989122 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:28.989610 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:28.989616 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:28.989619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:28.990032 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:28.990191 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:28.990730 (+ 539us) server_negotiation.cc:299] Negotiation successful
0812 06:57:28.990966 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 06:57:28.991535 22355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:28.975541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43433 (local address 127.18.70.129:56675)
0812 06:57:28.976172 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:28.976187 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:28.976309 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:28.976679 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:28.976685 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:28.977407 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:28.978046 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:28.978070 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:28.979404 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:28.979410 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:28.981300 (+ 1890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:28.981326 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:28.982365 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:28.982373 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:28.982599 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:28.983291 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:28.983318 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:28.984648 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:28.988093 (+ 3445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:28.988103 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:28.988107 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:28.988736 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:28.989280 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:28.989286 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:28.989290 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:28.989480 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:28.990180 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:28.990185 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:28.990432 (+ 247us) client_negotiation.cc:769] Sending connection context
0812 06:57:28.990619 (+ 187us) client_negotiation.cc:240] Negotiation successful
0812 06:57:28.990976 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":387,"threads_started":1}
I20260812 06:57:28.994201 22200 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:35837
I20260812 06:57:28.994203 22462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:35837 every 8 connection(s)
I20260812 06:57:28.995651 22200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:57:28.997485 22465 heartbeater.cc:347] Connected to a master server at 127.18.70.190:43433
I20260812 06:57:28.997695 22465 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:28.998301 22465 heartbeater.cc:511] Master 127.18.70.190:43433 requested a full tablet report, sending...
I20260812 06:57:29.000082 22061 ts_manager.cc:194] Registered new tserver with Master: a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837)
I20260812 06:57:29.000931 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 22200
I20260812 06:57:29.001133 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:57:29.001626 22061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:43413
I20260812 06:57:29.001754 18714 external_mini_cluster.cc:1428] Setting key bb501dc048c37e9db0b44ec62693441c
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 06:57:29.039040 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43433
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:39095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:29.351603 22473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:29.351847 22473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:29.351989 22473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:29.358865 22473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:29.358959 22473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:29.359084 22473 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:57:29.359146 22473 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:57:29.359246 22473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:57:29.368662 22473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:39095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.70.190:43433
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:29.369808 22473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:29.371095 22473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:29.383551 22486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:29.383606 22484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:29.383695 22482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:29.384346 22473 server_base.cc:1034] running on GCE node
I20260812 06:57:29.384899 22473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:29.385733 22473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:29.386914 22473 hybrid_clock.cc:648] HybridClock initialized: now 1786517849386859 us; error 50 us; skew 500 ppm
I20260812 06:57:29.387194 22473 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:29 dist-test-slave-tc2s krb5kdc[21964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517849, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:29.393836 22473 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:57:29.395133 22473 webserver.cc:460] Webserver started at http://127.18.70.130:42319/ using document root <none> and password file <none>
I20260812 06:57:29.395726 22473 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:29.395825 22473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:29.396083 22473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:29.398922 22473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "351850ad65824ee3a095867691310369"
format_stamp: "Formatted at 2026-08-12 06:57:29 on dist-test-slave-tc2s"
server_key: "8ba693292b285035e3542fb88e74ba22"
server_key_iv: "6c938a05d74cbdeb6c04cca9df49cb4c"
server_key_version: "encryptionkey@0"
I20260812 06:57:29.399612 22473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "351850ad65824ee3a095867691310369"
format_stamp: "Formatted at 2026-08-12 06:57:29 on dist-test-slave-tc2s"
server_key: "8ba693292b285035e3542fb88e74ba22"
server_key_iv: "6c938a05d74cbdeb6c04cca9df49cb4c"
server_key_version: "encryptionkey@0"
I20260812 06:57:29.404624 22473 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 06:57:29.408773 22503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:29.410068 22473 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:29.410212 22473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "351850ad65824ee3a095867691310369"
format_stamp: "Formatted at 2026-08-12 06:57:29 on dist-test-slave-tc2s"
server_key: "8ba693292b285035e3542fb88e74ba22"
server_key_iv: "6c938a05d74cbdeb6c04cca9df49cb4c"
server_key_version: "encryptionkey@0"
I20260812 06:57:29.410392 22473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:29.438465 22473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:29.442407 22473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:29.442678 22473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:29.445200 22473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:29.445350 22473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260812 06:57:29.445509 22473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:29.445622 22473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:57:29 dist-test-slave-tc2s krb5kdc[21964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517849, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:29.468356 22523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:29.446307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43433 (local address 127.18.70.130:48563)
0812 06:57:29.447182 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:29.447226 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:29.449068 (+ 1842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:29.449840 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:29.449852 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:29.450576 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:29.451344 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:29.451367 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.452968 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.452974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:29.454928 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:29.454941 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.455797 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.455806 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:29.456097 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:29.456836 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:29.456868 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:29.460160 (+ 3292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:29.463707 (+ 3547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:29.463716 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:29.463730 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:29.464313 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:29.464722 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:29.464727 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:29.464735 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:29.465049 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:29.465702 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:29.465710 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:29.466122 (+ 412us) client_negotiation.cc:769] Sending connection context
0812 06:57:29.466459 (+ 337us) client_negotiation.cc:240] Negotiation successful
0812 06:57:29.466989 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":360,"threads_started":1}
I20260812 06:57:29.469313 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:29.445993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:48563 (local address 127.18.70.190:43433)
0812 06:57:29.446174 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:29.446180 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:29.447342 (+ 1162us) server_negotiation.cc:407] Connection header received
0812 06:57:29.449320 (+ 1978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:29.449326 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:29.449411 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:29.449507 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:29.451616 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.452772 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.455080 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.455526 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.455660 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:29.460466 (+ 4806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:29.460475 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:29.460479 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:29.460523 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:29.463572 (+ 3049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:29.464443 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:29.464456 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:29.464458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:29.464590 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:29.465196 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:29.465202 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:29.465206 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:29.465561 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:29.465711 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:29.468851 (+ 3140us) server_negotiation.cc:299] Negotiation successful
0812 06:57:29.469090 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 06:57:29.486486 22473 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:46333
I20260812 06:57:29.486585 22721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:46333 every 8 connection(s)
I20260812 06:57:29.487725 22473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:57:29.487870 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:29.474106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:56749 (local address 127.18.70.190:43433)
0812 06:57:29.474266 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:29.474271 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:29.475120 (+ 849us) server_negotiation.cc:407] Connection header received
0812 06:57:29.475284 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:29.475289 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:29.475371 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:29.475464 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:29.476821 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.477749 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.479193 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.479676 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.479794 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:29.482215 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:29.482221 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:29.482226 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:29.482256 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:29.485116 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:29.485811 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:29.485816 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:29.485819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:29.486000 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:29.486402 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:29.486407 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:29.486411 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:29.486843 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:29.486982 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:29.487362 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 06:57:29.487552 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 06:57:29.487978 22657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:29.474248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43433 (local address 127.18.70.130:56749)
0812 06:57:29.475027 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:29.475041 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:29.475165 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:29.475633 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:29.475639 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:29.476183 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:29.476636 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:29.476650 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.477970 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.477975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:29.479058 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:29.479073 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.480002 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.480010 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:29.480213 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:29.480802 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:29.480826 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:29.481986 (+ 1160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:29.485231 (+ 3245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:29.485236 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:29.485240 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:29.485657 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:29.486111 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:29.486119 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:29.486123 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:29.486253 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:29.486954 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:29.486959 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:29.487137 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 06:57:29.487253 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 06:57:29.487563 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":522,"threads_started":1}
I20260812 06:57:29.489686 22724 heartbeater.cc:347] Connected to a master server at 127.18.70.190:43433
I20260812 06:57:29.489923 22724 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:29.490648 22724 heartbeater.cc:511] Master 127.18.70.190:43433 requested a full tablet report, sending...
I20260812 06:57:29.492007 22061 ts_manager.cc:194] Registered new tserver with Master: 351850ad65824ee3a095867691310369 (127.18.70.130:46333)
I20260812 06:57:29.492775 22061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:48563
I20260812 06:57:29.493503 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 22473
I20260812 06:57:29.493706 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:57:29.494278 18714 external_mini_cluster.cc:1428] Setting key a18cb90301027a1fc97e0592a45e9008
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 06:57:29.533152 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43433
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:39095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:29.846230 22737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:29.846494 22737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:29.846630 22737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:29.853493 22737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:29.853591 22737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:29.853718 22737 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:57:29.853781 22737 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:57:29.853879 22737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:57:29.863193 22737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:39095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.70.190:43433
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:29.864324 22737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:29.865568 22737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:29.878285 22750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:29.878173 22748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:29.878762 22755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:29.879186 22737 server_base.cc:1034] running on GCE node
I20260812 06:57:29.879739 22737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:29.880581 22737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:29.881762 22737 hybrid_clock.cc:648] HybridClock initialized: now 1786517849881718 us; error 36 us; skew 500 ppm
I20260812 06:57:29.882071 22737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:29 dist-test-slave-tc2s krb5kdc[21964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517849, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:29.884960 22737 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:57:29.886297 22737 webserver.cc:460] Webserver started at http://127.18.70.131:35001/ using document root <none> and password file <none>
I20260812 06:57:29.886920 22737 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:29.887042 22737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:29.887321 22737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:29.890036 22737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "6f3b6859948840179d9e3dc8e74bf508"
format_stamp: "Formatted at 2026-08-12 06:57:29 on dist-test-slave-tc2s"
server_key: "7079f843e8d0c0f4345f8bea6614bc3a"
server_key_iv: "edb4681a57c9b1e823ccd72399301aaa"
server_key_version: "encryptionkey@0"
I20260812 06:57:29.890753 22737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "6f3b6859948840179d9e3dc8e74bf508"
format_stamp: "Formatted at 2026-08-12 06:57:29 on dist-test-slave-tc2s"
server_key: "7079f843e8d0c0f4345f8bea6614bc3a"
server_key_iv: "edb4681a57c9b1e823ccd72399301aaa"
server_key_version: "encryptionkey@0"
I20260812 06:57:29.895553 22737 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 06:57:29.898833 22778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:29.900028 22737 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 06:57:29.900172 22737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "6f3b6859948840179d9e3dc8e74bf508"
format_stamp: "Formatted at 2026-08-12 06:57:29 on dist-test-slave-tc2s"
server_key: "7079f843e8d0c0f4345f8bea6614bc3a"
server_key_iv: "edb4681a57c9b1e823ccd72399301aaa"
server_key_version: "encryptionkey@0"
I20260812 06:57:29.900367 22737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:29.914805 22737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:29.918279 22737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:29.918517 22737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:29.920869 22737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:29.920974 22737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:29.921074 22737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:29.921149 22737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:57:29 dist-test-slave-tc2s krb5kdc[21964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517849, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:29.942482 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:29.921479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:53657 (local address 127.18.70.190:43433)
0812 06:57:29.921686 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:29.921692 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:29.923019 (+ 1327us) server_negotiation.cc:407] Connection header received
0812 06:57:29.924958 (+ 1939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:29.924965 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:29.925061 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:29.925175 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:29.927160 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.928161 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.930547 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.931233 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.931397 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:29.935625 (+ 4228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:29.935633 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:29.935638 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:29.935684 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:29.938783 (+ 3099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:29.939672 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:29.939679 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:29.939682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:29.939867 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:29.940421 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:29.940426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:29.940430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:29.940711 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:29.940850 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:29.941778 (+ 928us) server_negotiation.cc:299] Negotiation successful
0812 06:57:29.942079 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 06:57:29.943264 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:29.921983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43433 (local address 127.18.70.131:53657)
0812 06:57:29.922841 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:29.922887 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:29.924699 (+ 1812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:29.925429 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:29.925440 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:29.926165 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:29.926898 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:29.926929 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.928336 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.928340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:29.930361 (+ 2021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:29.930378 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.931468 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.931473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:29.931642 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:29.932263 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:29.932295 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:29.935327 (+ 3032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:29.938912 (+ 3585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:29.938921 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:29.938936 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:29.939523 (+ 587us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:29.940002 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:29.940006 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:29.940010 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:29.940275 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:29.940841 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:29.940858 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:29.941298 (+ 440us) client_negotiation.cc:769] Sending connection context
0812 06:57:29.941623 (+ 325us) client_negotiation.cc:240] Negotiation successful
0812 06:57:29.942079 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":349,"threads_started":1}
I20260812 06:57:29.962025 22737 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:46489
I20260812 06:57:29.962044 22977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:46489 every 8 connection(s)
I20260812 06:57:29.963495 22737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:57:29.965735 22978 heartbeater.cc:347] Connected to a master server at 127.18.70.190:43433
I20260812 06:57:29.966002 22978 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:29.966815 22978 heartbeater.cc:511] Master 127.18.70.190:43433 requested a full tablet report, sending...
I20260812 06:57:29.967049 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 22737
I20260812 06:57:29.967233 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:57:29.967710 18714 external_mini_cluster.cc:1428] Setting key 5a53d269c2faeade1e75a1c04c3e9610
I20260812 06:57:29.968446 22061 ts_manager.cc:194] Registered new tserver with Master: 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131:46489)
I20260812 06:57:29.969580 22061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:53657
I20260812 06:57:29.971127 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:57:29.971904 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:29.957461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:49557 (local address 127.18.70.190:43433)
0812 06:57:29.957636 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:29.957641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:29.958712 (+ 1071us) server_negotiation.cc:407] Connection header received
0812 06:57:29.958878 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:29.958884 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:29.958975 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:29.959079 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:29.960427 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.961389 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.963296 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.963764 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.963859 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:29.965935 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:29.965942 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:29.965947 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:29.965986 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:29.969252 (+ 3266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:29.969996 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:29.970001 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:29.970005 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:29.970132 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:29.970493 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:29.970498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:29.970502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:29.970779 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:29.970914 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:29.971405 (+ 491us) server_negotiation.cc:299] Negotiation successful
0812 06:57:29.971603 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 06:57:29.972751 22963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:29.957668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43433 (local address 127.18.70.131:49557)
0812 06:57:29.958614 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:29.958632 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:29.958754 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:29.959135 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:29.959141 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:29.959854 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:29.960261 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:29.960274 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.961548 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.961554 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:29.963147 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:29.963161 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:29.963959 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:29.963968 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:29.964230 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:29.964915 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:29.964938 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:29.965727 (+ 789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:29.969394 (+ 3667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:29.969400 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:29.969404 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:29.969876 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:29.970233 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:29.970238 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:29.970242 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:29.970382 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:29.970887 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:29.970892 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:29.971125 (+ 233us) client_negotiation.cc:769] Sending connection context
0812 06:57:29.971250 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 06:57:29.972329 (+ 1079us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":828,"mutex_wait_us":780,"thread_start_us":700,"threads_started":1}
Aug 12 06:57:29 dist-test-slave-tc2s krb5kdc[21964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
I20260812 06:57:30.004684 22465 heartbeater.cc:503] Master 127.18.70.190:43433 was elected leader, sending a full tablet report...
Aug 12 06:57:30 dist-test-slave-tc2s krb5kdc[21964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:30.017844 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.005462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37940 (local address 127.18.70.190:43433)
0812 06:57:30.005633 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.005639 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.005970 (+ 331us) server_negotiation.cc:407] Connection header received
0812 06:57:30.006120 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.006124 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.006198 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.006285 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:30.007589 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.008326 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.009457 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.009854 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.010014 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.013391 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:30.013397 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:30.013400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:30.013433 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:30.015813 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:30.016367 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:30.016370 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:30.016372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:30.016485 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:30.016739 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:30.016741 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:30.016743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:30.016986 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:30.017154 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.017349 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.017509 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 06:57:30.021425 22060 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37940:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:57:30.028234 22060 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:57:30.051169 23012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.040505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53036 (local address 127.18.70.130:46333)
0812 06:57:30.042374 (+ 1869us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.042382 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.043501 (+ 1119us) server_negotiation.cc:407] Connection header received
0812 06:57:30.043604 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.043611 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.043842 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.044025 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:30.044539 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.045544 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.048517 (+ 2973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.049814 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.050000 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.050206 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.050739 (+ 533us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.050913 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1730,"thread_start_us":1638,"threads_started":1}
I20260812 06:57:30.051182 23000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.039321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35837 (local address 127.0.0.1:53328)
0812 06:57:30.041030 (+ 1709us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:30.041065 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:30.041213 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:30.043662 (+ 2449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:30.043667 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:30.043690 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:30.044083 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.044104 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.045957 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.045962 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.048222 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.048235 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.050052 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.050059 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.050357 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.050448 (+ 91us) client_negotiation.cc:769] Sending connection context
0812 06:57:30.050573 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 06:57:30.050769 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1489,"mutex_wait_us":375,"thread_start_us":1327,"threads_started":1}
I20260812 06:57:30.051826 23005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.039966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:46333 (local address 127.0.0.1:53036)
0812 06:57:30.043256 (+ 3290us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:30.043271 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:30.043378 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:30.044034 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:30.044038 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:30.044068 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:30.044381 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.044390 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.045671 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.045676 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.048369 (+ 2693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.048383 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.050087 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.050095 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.050353 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.050456 (+ 103us) client_negotiation.cc:769] Sending connection context
0812 06:57:30.050573 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 06:57:30.051577 (+ 1004us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3166,"mutex_wait_us":965,"thread_start_us":1555,"threads_started":1}
I20260812 06:57:30.051883 23001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.039507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53328 (local address 127.18.70.129:35837)
0812 06:57:30.043060 (+ 3553us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.043068 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.043095 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:57:30.043185 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.043193 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.043403 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.043645 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:30.044265 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.045757 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.048383 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.049828 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.050000 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.050207 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.051346 (+ 1139us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.051521 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3415,"thread_start_us":3284,"threads_started":1}
I20260812 06:57:30.053115 23009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.039847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:46489 (local address 127.0.0.1:38724)
0812 06:57:30.041798 (+ 1951us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:30.041816 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:30.041947 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:30.043251 (+ 1304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:30.043258 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:30.043301 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:30.043680 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.043693 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.045877 (+ 2184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.045882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.048374 (+ 2492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.048383 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.052436 (+ 4053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.052442 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.052599 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.052630 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 06:57:30.052721 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 06:57:30.052838 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1805,"mutex_wait_us":20,"thread_start_us":2660,"threads_started":1}
I20260812 06:57:30.055562 22595 tablet_service.cc:1467] Processing CreateTablet for tablet 5199832b292247beb7fe9c23e2f970e2 (DEFAULT_TABLE table=test-table [id=71add48504a8401cb5503c8ae9f3f557]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:30.055562 22333 tablet_service.cc:1467] Processing CreateTablet for tablet 5199832b292247beb7fe9c23e2f970e2 (DEFAULT_TABLE table=test-table [id=71add48504a8401cb5503c8ae9f3f557]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:30.057013 22595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5199832b292247beb7fe9c23e2f970e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:30.056990 22333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5199832b292247beb7fe9c23e2f970e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:30.061216 23016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.040998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38724 (local address 127.18.70.131:46489)
0812 06:57:30.042345 (+ 1347us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.042361 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.042393 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:57:30.042497 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.042505 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.042745 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.042935 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:30.043972 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.045727 (+ 1755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.050310 (+ 4583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.052242 (+ 1932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.052376 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.052592 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.060862 (+ 8270us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.060992 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1156,"thread_start_us":963,"threads_started":1}
I20260812 06:57:30.064214 22862 tablet_service.cc:1467] Processing CreateTablet for tablet 5199832b292247beb7fe9c23e2f970e2 (DEFAULT_TABLE table=test-table [id=71add48504a8401cb5503c8ae9f3f557]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:30.065303 22862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5199832b292247beb7fe9c23e2f970e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:30.074563 23018 tablet_bootstrap.cc:492] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: Bootstrap starting.
I20260812 06:57:30.075312 23020 tablet_bootstrap.cc:492] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: Bootstrap starting.
I20260812 06:57:30.076496 23022 tablet_bootstrap.cc:492] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: Bootstrap starting.
I20260812 06:57:30.078460 23018 tablet_bootstrap.cc:654] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:30.079416 23020 tablet_bootstrap.cc:654] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:30.079695 23018 log.cc:824] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:30.079873 23022 tablet_bootstrap.cc:654] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:30.080673 23020 log.cc:824] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:30.081094 23022 log.cc:824] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:30.082510 23018 tablet_bootstrap.cc:492] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: No bootstrap required, opened a new log
I20260812 06:57:30.082782 23018 ts_tablet_manager.cc:1397] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 06:57:30.083540 23020 tablet_bootstrap.cc:492] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: No bootstrap required, opened a new log
I20260812 06:57:30.083773 23020 ts_tablet_manager.cc:1397] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 06:57:30.084000 23022 tablet_bootstrap.cc:492] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: No bootstrap required, opened a new log
I20260812 06:57:30.084260 23022 ts_tablet_manager.cc:1397] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260812 06:57:30.090914 23020 raft_consensus.cc:348] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.091228 23020 raft_consensus.cc:374] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:30.091369 23020 raft_consensus.cc:729] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4df4de6e6aa4604887d506e58f9352e, State: Initialized, Role: FOLLOWER
I20260812 06:57:30.091908 23020 consensus_queue.cc:260] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.092809 23018 raft_consensus.cc:348] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.093254 23018 raft_consensus.cc:374] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:30.093384 23018 raft_consensus.cc:729] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 351850ad65824ee3a095867691310369, State: Initialized, Role: FOLLOWER
I20260812 06:57:30.093490 23020 ts_tablet_manager.cc:1428] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260812 06:57:30.094094 23018 consensus_queue.cc:260] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.094043 23022 raft_consensus.cc:348] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.094403 23022 raft_consensus.cc:374] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:30.094516 23022 raft_consensus.cc:729] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3b6859948840179d9e3dc8e74bf508, State: Initialized, Role: FOLLOWER
I20260812 06:57:30.095132 22724 heartbeater.cc:503] Master 127.18.70.190:43433 was elected leader, sending a full tablet report...
I20260812 06:57:30.095697 23018 ts_tablet_manager.cc:1428] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260812 06:57:30.096203 23022 consensus_queue.cc:260] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.097515 22978 heartbeater.cc:503] Master 127.18.70.190:43433 was elected leader, sending a full tablet report...
I20260812 06:57:30.097764 23022 ts_tablet_manager.cc:1428] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260812 06:57:30.136112 23036 raft_consensus.cc:482] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:57:30.136395 23036 raft_consensus.cc:504] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.138141 23036 leader_election.cc:288] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837), 351850ad65824ee3a095867691310369 (127.18.70.130:46333)
I20260812 06:57:30.144250 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.138438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:46333 (local address 127.18.70.131:36701)
0812 06:57:30.138776 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:30.138797 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:30.138941 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:30.139302 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:30.139305 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:30.139328 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:30.139588 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.139601 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.140826 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.140831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.142272 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.142284 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.143535 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.143541 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.143725 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.143760 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 06:57:30.143856 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 06:57:30.143985 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"spinlock_wait_cycles":19328}
I20260812 06:57:30.144325 23012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.138577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:36701 (local address 127.18.70.130:46333)
0812 06:57:30.138791 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.138805 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.138883 (+ 78us) server_negotiation.cc:407] Connection header received
0812 06:57:30.139092 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.139097 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.139174 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.139276 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:30.139743 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.140694 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.142429 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.143379 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.143502 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.143555 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.143925 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.144064 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260812 06:57:30.144814 23001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.138604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:51901 (local address 127.18.70.129:35837)
0812 06:57:30.138780 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.138798 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.139379 (+ 581us) server_negotiation.cc:407] Connection header received
0812 06:57:30.139562 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.139568 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.139660 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.139749 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:30.140306 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.141117 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.142985 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.143881 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.144023 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.144088 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.144523 (+ 435us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.144630 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:57:30.145445 23040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.138535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35837 (local address 127.18.70.131:51901)
0812 06:57:30.139264 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:30.139290 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:30.139427 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:30.139781 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:30.139785 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:30.139825 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:30.140158 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.140170 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.141246 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.141250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.142822 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.142838 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.144114 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.144121 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.144316 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.144356 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 06:57:30.144990 (+ 634us) client_negotiation.cc:240] Negotiation successful
0812 06:57:30.145116 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":399,"threads_started":1}
I20260812 06:57:30.145270 22632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5199832b292247beb7fe9c23e2f970e2" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "351850ad65824ee3a095867691310369" is_pre_election: true
I20260812 06:57:30.145792 22632 raft_consensus.cc:2454] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3b6859948840179d9e3dc8e74bf508 in term 0.
I20260812 06:57:30.146494 22782 leader_election.cc:302] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 351850ad65824ee3a095867691310369, 6f3b6859948840179d9e3dc8e74bf508; no voters:
I20260812 06:57:30.146482 22384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5199832b292247beb7fe9c23e2f970e2" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4df4de6e6aa4604887d506e58f9352e" is_pre_election: true
I20260812 06:57:30.146831 23036 raft_consensus.cc:2781] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:57:30.146987 23036 raft_consensus.cc:482] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:57:30.147017 22384 raft_consensus.cc:2454] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3b6859948840179d9e3dc8e74bf508 in term 0.
I20260812 06:57:30.147100 23036 raft_consensus.cc:3037] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:30.149403 23036 raft_consensus.cc:504] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.150007 23036 leader_election.cc:288] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 election: Requested vote from peers a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837), 351850ad65824ee3a095867691310369 (127.18.70.130:46333)
I20260812 06:57:30.150282 22384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5199832b292247beb7fe9c23e2f970e2" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4df4de6e6aa4604887d506e58f9352e"
I20260812 06:57:30.150445 22384 raft_consensus.cc:3037] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:30.150628 22632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5199832b292247beb7fe9c23e2f970e2" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "351850ad65824ee3a095867691310369"
I20260812 06:57:30.150825 22632 raft_consensus.cc:3037] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:30.153436 22384 raft_consensus.cc:2454] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3b6859948840179d9e3dc8e74bf508 in term 1.
I20260812 06:57:30.153813 22783 leader_election.cc:302] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3b6859948840179d9e3dc8e74bf508, a4df4de6e6aa4604887d506e58f9352e; no voters:
I20260812 06:57:30.153860 22632 raft_consensus.cc:2454] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3b6859948840179d9e3dc8e74bf508 in term 1.
I20260812 06:57:30.154150 23036 raft_consensus.cc:2781] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:30.154569 23036 raft_consensus.cc:686] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 LEADER]: Becoming Leader. State: Replica: 6f3b6859948840179d9e3dc8e74bf508, State: Running, Role: LEADER
I20260812 06:57:30.155001 23036 consensus_queue.cc:237] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.159353 22060 catalog_manager.cc:5495] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131). New cstate: current_term: 1 leader_uuid: "6f3b6859948840179d9e3dc8e74bf508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } health_report { overall_health: HEALTHY } } }
W20260812 06:57:30.215209 22980 tablet.cc:2369] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 06:57:30 dist-test-slave-tc2s krb5kdc[21964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517848, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:30.224457 23052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.212041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43433 (local address 127.0.0.1:37946)
0812 06:57:30.212545 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:30.212560 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:30.212673 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:30.212932 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:30.212935 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:30.213573 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:30.213832 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.213841 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.214941 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.214956 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.216234 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.216246 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.216942 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.216958 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.217083 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.217635 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:30.217655 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:30.219716 (+ 2061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:30.222316 (+ 2600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:30.222327 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:30.222333 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:30.222728 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:30.223054 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:30.223058 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:30.223060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:30.223203 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:30.223669 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:30.223675 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:30.223819 (+ 144us) client_negotiation.cc:769] Sending connection context
0812 06:57:30.223943 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 06:57:30.224135 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":264,"threads_started":1}
I20260812 06:57:30.224485 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.211986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37946 (local address 127.18.70.190:43433)
0812 06:57:30.212137 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.212141 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.212639 (+ 498us) server_negotiation.cc:407] Connection header received
0812 06:57:30.212759 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.212762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.212822 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.212928 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:30.214025 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.214816 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.216359 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.216796 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.216889 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.219888 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:30.219893 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:30.219897 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:30.219931 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:30.222195 (+ 2264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:30.222817 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:30.222821 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:30.222823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:30.222966 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:30.223291 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:30.223294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:30.223296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:30.223568 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:30.223675 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.224038 (+ 363us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.224246 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":49}
I20260812 06:57:30.228924 22060 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:37946:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:57:30.229919 22060 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:57:30.235960 22333 tablet_service.cc:1467] Processing CreateTablet for tablet 2de21a4e33194484b41925a7029efe64 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=81dd37ff53374a3592dd8602692a3dc8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:57:30.236129 22595 tablet_service.cc:1467] Processing CreateTablet for tablet 2de21a4e33194484b41925a7029efe64 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=81dd37ff53374a3592dd8602692a3dc8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:57:30.236387 22862 tablet_service.cc:1467] Processing CreateTablet for tablet 2de21a4e33194484b41925a7029efe64 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=81dd37ff53374a3592dd8602692a3dc8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:57:30.236974 22595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2de21a4e33194484b41925a7029efe64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:30.236974 22333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2de21a4e33194484b41925a7029efe64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:30.237136 22862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2de21a4e33194484b41925a7029efe64. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 06:57:30.239971 22726 tablet.cc:2369] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:57:30.243150 23018 tablet_bootstrap.cc:492] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: Bootstrap starting.
I20260812 06:57:30.243886 23020 tablet_bootstrap.cc:492] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e: Bootstrap starting.
I20260812 06:57:30.244345 23022 tablet_bootstrap.cc:492] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508: Bootstrap starting.
I20260812 06:57:30.244809 23018 tablet_bootstrap.cc:654] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:30.245414 23020 tablet_bootstrap.cc:654] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:30.246114 23022 tablet_bootstrap.cc:654] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:30.247022 23018 tablet_bootstrap.cc:492] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: No bootstrap required, opened a new log
I20260812 06:57:30.247149 23018 ts_tablet_manager.cc:1397] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
W20260812 06:57:30.247793 22466 tablet.cc:2369] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:57:30.247802 23018 raft_consensus.cc:348] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.248056 23018 raft_consensus.cc:374] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:30.248152 23022 tablet_bootstrap.cc:492] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508: No bootstrap required, opened a new log
I20260812 06:57:30.248162 23018 raft_consensus.cc:729] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 351850ad65824ee3a095867691310369, State: Initialized, Role: FOLLOWER
I20260812 06:57:30.248291 23022 ts_tablet_manager.cc:1397] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 06:57:30.248406 23018 consensus_queue.cc:260] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.248971 23018 ts_tablet_manager.cc:1428] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:57:30.248850 23034 tablet_replica.cc:439] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } } }
I20260812 06:57:30.249042 23022 raft_consensus.cc:348] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.249202 23034 tablet_replica.cc:442] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:30.249279 23022 raft_consensus.cc:374] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:30.249396 23022 raft_consensus.cc:729] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3b6859948840179d9e3dc8e74bf508, State: Initialized, Role: FOLLOWER
I20260812 06:57:30.249610 23022 consensus_queue.cc:260] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.250006 23036 tablet_replica.cc:439] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } } }
I20260812 06:57:30.250196 23022 ts_tablet_manager.cc:1428] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:57:30.250303 23036 tablet_replica.cc:442] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:30.251137 23020 tablet_bootstrap.cc:492] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e: No bootstrap required, opened a new log
I20260812 06:57:30.251274 23020 ts_tablet_manager.cc:1397] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260812 06:57:30.252056 23020 raft_consensus.cc:348] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.252234 23020 raft_consensus.cc:374] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:30.252327 23020 raft_consensus.cc:729] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4df4de6e6aa4604887d506e58f9352e, State: Initialized, Role: FOLLOWER
I20260812 06:57:30.252534 23020 consensus_queue.cc:260] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.253127 23020 ts_tablet_manager.cc:1428] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:57:30.253018 23032 tablet_replica.cc:439] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } } }
I20260812 06:57:30.253443 23032 tablet_replica.cc:442] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:30.396037 23034 raft_consensus.cc:482] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:57:30.396271 23034 raft_consensus.cc:504] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.397876 23034 leader_election.cc:288] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837), 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131:46489)
I20260812 06:57:30.404471 23001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.398320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:40759 (local address 127.18.70.129:35837)
0812 06:57:30.398542 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.398549 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.398976 (+ 427us) server_negotiation.cc:407] Connection header received
0812 06:57:30.399170 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.399174 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.399242 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.399316 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:30.399918 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.400686 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.402630 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.403584 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.403756 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.403829 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.404101 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.404221 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 06:57:30.404600 23016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.398390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:55951 (local address 127.18.70.131:46489)
0812 06:57:30.398641 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.398647 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.399381 (+ 734us) server_negotiation.cc:407] Connection header received
0812 06:57:30.399643 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.399648 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.399727 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.399810 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:30.400336 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.401033 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.402757 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.403686 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.403839 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.403944 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.404232 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.404354 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260812 06:57:30.404780 23066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.398163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:46489 (local address 127.18.70.130:55951)
0812 06:57:30.399272 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:30.399286 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:30.399494 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:30.399848 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:30.399852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:30.399876 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:30.400172 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.400182 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.401167 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.401171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.402599 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.402615 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.403881 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.403889 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.404081 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.404105 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 06:57:30.404186 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 06:57:30.404305 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1016,"mutex_wait_us":494,"spinlock_wait_cycles":73344,"thread_start_us":282,"threads_started":1}
I20260812 06:57:30.404834 23065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.398153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35837 (local address 127.18.70.130:40759)
0812 06:57:30.398864 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:30.398887 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:30.399028 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:30.399356 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:30.399361 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:30.399389 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:30.399759 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.399773 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.400816 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.400822 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.402466 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.402478 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.403784 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.403790 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.403954 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.403979 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 06:57:30.404059 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:57:30.404179 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"mutex_wait_us":1,"thread_start_us":409,"threads_started":1}
I20260812 06:57:30.405547 22384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2de21a4e33194484b41925a7029efe64" candidate_uuid: "351850ad65824ee3a095867691310369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4df4de6e6aa4604887d506e58f9352e" is_pre_election: true
I20260812 06:57:30.405778 22384 raft_consensus.cc:2454] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 351850ad65824ee3a095867691310369 in term 0.
I20260812 06:57:30.405697 22893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2de21a4e33194484b41925a7029efe64" candidate_uuid: "351850ad65824ee3a095867691310369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3b6859948840179d9e3dc8e74bf508" is_pre_election: true
I20260812 06:57:30.406088 22893 raft_consensus.cc:2454] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 351850ad65824ee3a095867691310369 in term 0.
I20260812 06:57:30.406229 22510 leader_election.cc:302] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 351850ad65824ee3a095867691310369, a4df4de6e6aa4604887d506e58f9352e; no voters:
I20260812 06:57:30.406611 23034 raft_consensus.cc:2781] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:57:30.406749 23034 raft_consensus.cc:482] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:57:30.406845 23034 raft_consensus.cc:3037] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:30.408916 23034 raft_consensus.cc:504] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.409452 23034 leader_election.cc:288] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [CANDIDATE]: Term 1 election: Requested vote from peers a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837), 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131:46489)
I20260812 06:57:30.409857 22384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2de21a4e33194484b41925a7029efe64" candidate_uuid: "351850ad65824ee3a095867691310369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4df4de6e6aa4604887d506e58f9352e"
I20260812 06:57:30.409950 22893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2de21a4e33194484b41925a7029efe64" candidate_uuid: "351850ad65824ee3a095867691310369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3b6859948840179d9e3dc8e74bf508"
I20260812 06:57:30.410107 22384 raft_consensus.cc:3037] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:30.410115 22893 raft_consensus.cc:3037] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:30.412037 22384 raft_consensus.cc:2454] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 351850ad65824ee3a095867691310369 in term 1.
I20260812 06:57:30.412154 22893 raft_consensus.cc:2454] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 351850ad65824ee3a095867691310369 in term 1.
I20260812 06:57:30.412380 22510 leader_election.cc:302] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 351850ad65824ee3a095867691310369, a4df4de6e6aa4604887d506e58f9352e; no voters:
I20260812 06:57:30.412635 23034 raft_consensus.cc:2781] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:30.413039 23034 raft_consensus.cc:686] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [term 1 LEADER]: Becoming Leader. State: Replica: 351850ad65824ee3a095867691310369, State: Running, Role: LEADER
I20260812 06:57:30.413534 23034 consensus_queue.cc:237] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.416392 23068 tablet_replica.cc:439] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: TxnStatusTablet state changed. Reason: New leader 351850ad65824ee3a095867691310369. Latest consensus state: current_term: 1 leader_uuid: "351850ad65824ee3a095867691310369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } } }
I20260812 06:57:30.416708 23068 tablet_replica.cc:442] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:57:30.417397 23070 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:57:30.417635 23070 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:57:30.418409 22061 catalog_manager.cc:5495] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 reported cstate change: term changed from 0 to 1, leader changed from <none> to 351850ad65824ee3a095867691310369 (127.18.70.130). New cstate: current_term: 1 leader_uuid: "351850ad65824ee3a095867691310369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } health_report { overall_health: UNKNOWN } } }
I20260812 06:57:30.435750 23012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.430038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53038 (local address 127.18.70.130:46333)
0812 06:57:30.430204 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.430209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.430271 (+ 62us) server_negotiation.cc:407] Connection header received
0812 06:57:30.430532 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.430536 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.430607 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.430741 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:30.431075 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.431856 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.433564 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.434033 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.434151 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.434617 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:30.435103 (+ 486us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:30.435242 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.435341 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.435424 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 06:57:30.435758 23052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.429944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:46333 (local address 127.0.0.1:53038)
0812 06:57:30.430183 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:30.430203 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:30.430341 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:30.430764 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:30.430768 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:30.430780 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:57:30.430951 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.430959 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.431993 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.431999 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.433422 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.433436 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.434192 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.434198 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.434374 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.434438 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:57:30.435213 (+ 775us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:57:30.435236 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 06:57:30.435315 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 06:57:30.435473 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 06:57:30.445412 22893 raft_consensus.cc:1261] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Refusing update from remote peer 351850ad65824ee3a095867691310369: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:30.445792 22384 raft_consensus.cc:1261] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Refusing update from remote peer 351850ad65824ee3a095867691310369: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:30.447009 23034 consensus_queue.cc:1035] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:30.447507 23068 consensus_queue.cc:1035] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:30.459306 23036 tablet_replica.cc:439] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508: TxnStatusTablet state changed. Reason: New leader 351850ad65824ee3a095867691310369. Latest consensus state: current_term: 1 leader_uuid: "351850ad65824ee3a095867691310369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } } }
I20260812 06:57:30.464035 23036 tablet_replica.cc:442] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:30.471063 23073 mvcc.cc:205] Tried to move back new op lower bound from 7317577115411742720 to 7317577115297787904. Current Snapshot: MvccSnapshot[applied={T|T < 7317577115411742720}]
I20260812 06:57:30.471740 23032 tablet_replica.cc:439] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e: TxnStatusTablet state changed. Reason: New leader 351850ad65824ee3a095867691310369. Latest consensus state: current_term: 1 leader_uuid: "351850ad65824ee3a095867691310369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } } }
I20260812 06:57:30.472285 23032 tablet_replica.cc:442] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:30.472227 23068 tablet_replica.cc:439] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "351850ad65824ee3a095867691310369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } } }
I20260812 06:57:30.472671 23068 tablet_replica.cc:442] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:57:30.479683 23036 tablet_replica.cc:439] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "351850ad65824ee3a095867691310369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } } }
I20260812 06:57:30.480145 23036 tablet_replica.cc:442] T 2de21a4e33194484b41925a7029efe64 P 6f3b6859948840179d9e3dc8e74bf508: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:30.482322 23034 tablet_replica.cc:439] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "351850ad65824ee3a095867691310369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } } }
I20260812 06:57:30.482760 23034 tablet_replica.cc:442] T 2de21a4e33194484b41925a7029efe64 P 351850ad65824ee3a095867691310369: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:57:30.488333 23032 tablet_replica.cc:439] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "351850ad65824ee3a095867691310369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } } }
I20260812 06:57:30.488706 23032 tablet_replica.cc:442] T 2de21a4e33194484b41925a7029efe64 P a4df4de6e6aa4604887d506e58f9352e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:57:30.505983 23016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.496568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38734 (local address 127.18.70.131:46489)
0812 06:57:30.497527 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.497540 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.497555 (+ 15us) server_negotiation.cc:407] Connection header received
0812 06:57:30.497677 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.497681 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.497792 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.498141 (+ 349us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:30.498785 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.500364 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.502417 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.503288 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.503464 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.504227 (+ 763us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:30.505167 (+ 940us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:30.505333 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.505443 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.505576 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751}
I20260812 06:57:30.528410 23012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.521366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:44479 (local address 127.18.70.130:46333)
0812 06:57:30.521614 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.521625 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.521757 (+ 132us) server_negotiation.cc:407] Connection header received
0812 06:57:30.522244 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.522257 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.522347 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.522434 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:30.523103 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.524175 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.526072 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.526683 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.526839 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.527392 (+ 553us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:30.527520 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:30.527645 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.527812 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.527932 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260812 06:57:30.528594 23096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.520736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:46333 (local address 127.18.70.131:44479)
0812 06:57:30.521614 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:30.521651 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:30.522005 (+ 354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:30.522475 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:30.522484 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:30.522501 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:57:30.522876 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.522893 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.524329 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.524334 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.525844 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.525861 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.526903 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.526911 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.527114 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.527179 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:57:30.527645 (+ 466us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:57:30.527670 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 06:57:30.527782 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 06:57:30.527953 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":923,"threads_started":1}
I20260812 06:57:30.543802 22632 raft_consensus.cc:1261] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Refusing update from remote peer 6f3b6859948840179d9e3dc8e74bf508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:30.543850 22384 raft_consensus.cc:1261] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Refusing update from remote peer 6f3b6859948840179d9e3dc8e74bf508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:30.544912 23041 consensus_queue.cc:1035] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:30.545439 23036 consensus_queue.cc:1035] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:30.603000 23016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.593293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:38227 (local address 127.18.70.131:46489)
0812 06:57:30.593570 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:30.593575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:30.594709 (+ 1134us) server_negotiation.cc:407] Connection header received
0812 06:57:30.595008 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:30.595016 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:30.595152 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:30.595275 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:30.596201 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.597668 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.600283 (+ 2615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.600969 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.601194 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.601762 (+ 568us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:30.601980 (+ 218us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:30.602121 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:30.602386 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 06:57:30.602505 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260812 06:57:30.603359 23103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:30.593222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:46489 (local address 127.18.70.130:38227)
0812 06:57:30.594590 (+ 1368us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:30.594610 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:30.594815 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:30.595384 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:30.595389 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:30.595418 (+ 29us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:57:30.595986 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.596005 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.597856 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.597878 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.600089 (+ 2211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:30.600115 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:30.601230 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:30.601239 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:30.601459 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:30.601529 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:57:30.602142 (+ 613us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:57:30.602168 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 06:57:30.602347 (+ 179us) client_negotiation.cc:240] Negotiation successful
0812 06:57:30.602563 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1056,"thread_start_us":793,"threads_started":1}
I20260812 06:57:30.677130 22061 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:30.677604 22061 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:30.684890 22061 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619: Sending DeleteTablet for 3 replicas of tablet 5199832b292247beb7fe9c23e2f970e2
I20260812 06:57:30.686885 22333 tablet_service.cc:1514] Processing DeleteTablet for tablet 5199832b292247beb7fe9c23e2f970e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:30 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:53328
I20260812 06:57:30.687072 22862 tablet_service.cc:1514] Processing DeleteTablet for tablet 5199832b292247beb7fe9c23e2f970e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:30 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:38724
I20260812 06:57:30.688580 22595 tablet_service.cc:1514] Processing DeleteTablet for tablet 5199832b292247beb7fe9c23e2f970e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:30 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:53036
I20260812 06:57:30.700621 23114 tablet_replica.cc:330] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: stopping tablet replica
I20260812 06:57:30.701391 23114 raft_consensus.cc:2229] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:57:30.702478 23114 raft_consensus.cc:2258] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:30.702219 22061 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37940:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:57:30.705840 22061 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:57:30.706226 23114 ts_tablet_manager.cc:1905] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:30.718950 23115 tablet_replica.cc:330] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: stopping tablet replica
I20260812 06:57:30.719740 23115 raft_consensus.cc:2229] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:30.720239 23115 raft_consensus.cc:2258] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:30.721552 23113 tablet_replica.cc:330] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: stopping tablet replica
I20260812 06:57:30.722433 23113 raft_consensus.cc:2229] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:30.722842 22332 tablet_service.cc:1467] Processing CreateTablet for tablet 48225d0f68f546a487424c3f8757e115 (DEFAULT_TABLE table=test-table [id=9672d599ba464ed393ac4a33ff62d27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:30.723170 23113 raft_consensus.cc:2258] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:30.723728 22332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48225d0f68f546a487424c3f8757e115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:30.724465 22862 tablet_service.cc:1467] Processing CreateTablet for tablet 48225d0f68f546a487424c3f8757e115 (DEFAULT_TABLE table=test-table [id=9672d599ba464ed393ac4a33ff62d27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:30.725133 22862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48225d0f68f546a487424c3f8757e115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:30.726528 23115 ts_tablet_manager.cc:1905] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:30.732499 23113 ts_tablet_manager.cc:1905] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:30.739267 23022 tablet_bootstrap.cc:492] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508: Bootstrap starting.
I20260812 06:57:30.740053 22595 tablet_service.cc:1467] Processing CreateTablet for tablet 48225d0f68f546a487424c3f8757e115 (DEFAULT_TABLE table=test-table [id=9672d599ba464ed393ac4a33ff62d27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:30.740830 22595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48225d0f68f546a487424c3f8757e115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:30.745496 23115 ts_tablet_manager.cc:1918] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:57:30.745757 23114 ts_tablet_manager.cc:1918] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:57:30.746023 23114 log.cc:1196] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/5199832b292247beb7fe9c23e2f970e2
I20260812 06:57:30.746572 23020 tablet_bootstrap.cc:492] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e: Bootstrap starting.
I20260812 06:57:30.747022 23114 ts_tablet_manager.cc:1939] T 5199832b292247beb7fe9c23e2f970e2 P 6f3b6859948840179d9e3dc8e74bf508: Deleting consensus metadata
I20260812 06:57:30.748538 23022 tablet_bootstrap.cc:654] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:30.749536 23020 tablet_bootstrap.cc:654] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:30.752120 22035 catalog_manager.cc:4841] TS 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131:46489): tablet 5199832b292247beb7fe9c23e2f970e2 (table test-table [id=71add48504a8401cb5503c8ae9f3f557]) successfully deleted
I20260812 06:57:30.756301 23113 ts_tablet_manager.cc:1918] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:57:30.756645 23113 log.cc:1196] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/5199832b292247beb7fe9c23e2f970e2
I20260812 06:57:30.757429 23113 ts_tablet_manager.cc:1939] T 5199832b292247beb7fe9c23e2f970e2 P a4df4de6e6aa4604887d506e58f9352e: Deleting consensus metadata
I20260812 06:57:30.745913 23115 log.cc:1196] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/5199832b292247beb7fe9c23e2f970e2
I20260812 06:57:30.760066 23115 ts_tablet_manager.cc:1939] T 5199832b292247beb7fe9c23e2f970e2 P 351850ad65824ee3a095867691310369: Deleting consensus metadata
I20260812 06:57:30.765969 22032 catalog_manager.cc:4841] TS 351850ad65824ee3a095867691310369 (127.18.70.130:46333): tablet 5199832b292247beb7fe9c23e2f970e2 (table test-table [id=71add48504a8401cb5503c8ae9f3f557]) successfully deleted
I20260812 06:57:30.766705 23020 tablet_bootstrap.cc:492] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e: No bootstrap required, opened a new log
I20260812 06:57:30.767226 23020 ts_tablet_manager.cc:1397] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.004s
I20260812 06:57:30.767663 23022 tablet_bootstrap.cc:492] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508: No bootstrap required, opened a new log
I20260812 06:57:30.768045 23022 ts_tablet_manager.cc:1397] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.007s
I20260812 06:57:30.769488 22033 catalog_manager.cc:4841] TS a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837): tablet 5199832b292247beb7fe9c23e2f970e2 (table test-table [id=71add48504a8401cb5503c8ae9f3f557]) successfully deleted
I20260812 06:57:30.770422 23020 raft_consensus.cc:348] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.770870 23020 raft_consensus.cc:374] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:30.771027 23020 raft_consensus.cc:729] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4df4de6e6aa4604887d506e58f9352e, State: Initialized, Role: FOLLOWER
I20260812 06:57:30.771446 23020 consensus_queue.cc:260] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.769423 23022 raft_consensus.cc:348] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.772972 23022 raft_consensus.cc:374] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:30.773207 23022 raft_consensus.cc:729] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3b6859948840179d9e3dc8e74bf508, State: Initialized, Role: FOLLOWER
I20260812 06:57:30.773993 23022 consensus_queue.cc:260] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.774683 23036 raft_consensus.cc:482] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:57:30.774878 23036 raft_consensus.cc:504] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.776360 23036 leader_election.cc:288] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837), 351850ad65824ee3a095867691310369 (127.18.70.130:46333)
I20260812 06:57:30.776696 23020 ts_tablet_manager.cc:1428] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260812 06:57:30.777851 22384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48225d0f68f546a487424c3f8757e115" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4df4de6e6aa4604887d506e58f9352e" is_pre_election: true
I20260812 06:57:30.778319 22384 raft_consensus.cc:2454] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3b6859948840179d9e3dc8e74bf508 in term 0.
I20260812 06:57:30.780606 22783 leader_election.cc:302] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3b6859948840179d9e3dc8e74bf508, a4df4de6e6aa4604887d506e58f9352e; no voters:
I20260812 06:57:30.781219 23036 raft_consensus.cc:2781] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:57:30.781461 23036 raft_consensus.cc:482] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:57:30.781643 23036 raft_consensus.cc:3037] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:30.782424 22632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48225d0f68f546a487424c3f8757e115" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "351850ad65824ee3a095867691310369" is_pre_election: true
I20260812 06:57:30.782826 23122 tablet_bootstrap.cc:492] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369: Bootstrap starting.
W20260812 06:57:30.783603 22782 leader_election.cc:341] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 351850ad65824ee3a095867691310369 (127.18.70.130:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260812 06:57:30.785965 23122 tablet_bootstrap.cc:654] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:30.786295 23036 raft_consensus.cc:504] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.788293 23022 ts_tablet_manager.cc:1428] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508: Time spent starting tablet: real 0.020s user 0.000s sys 0.004s
I20260812 06:57:30.797735 22384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48225d0f68f546a487424c3f8757e115" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4df4de6e6aa4604887d506e58f9352e"
I20260812 06:57:30.798080 22384 raft_consensus.cc:3037] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:30.802990 22384 raft_consensus.cc:2454] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3b6859948840179d9e3dc8e74bf508 in term 1.
I20260812 06:57:30.803880 22783 leader_election.cc:302] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3b6859948840179d9e3dc8e74bf508, a4df4de6e6aa4604887d506e58f9352e; no voters:
I20260812 06:57:30.804296 23106 raft_consensus.cc:2781] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:30.804548 23106 raft_consensus.cc:686] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 LEADER]: Becoming Leader. State: Replica: 6f3b6859948840179d9e3dc8e74bf508, State: Running, Role: LEADER
I20260812 06:57:30.804961 23036 leader_election.cc:288] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 election: Requested vote from peers a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837), 351850ad65824ee3a095867691310369 (127.18.70.130:46333)
I20260812 06:57:30.805116 23106 consensus_queue.cc:237] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.807686 22632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48225d0f68f546a487424c3f8757e115" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "351850ad65824ee3a095867691310369"
W20260812 06:57:30.808904 22782 leader_election.cc:341] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 351850ad65824ee3a095867691310369 (127.18.70.130:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260812 06:57:30.811756 23122 tablet_bootstrap.cc:492] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369: No bootstrap required, opened a new log
I20260812 06:57:30.812027 23122 ts_tablet_manager.cc:1397] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.020s
I20260812 06:57:30.813256 23122 raft_consensus.cc:348] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.813716 23122 raft_consensus.cc:374] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:30.813295 22061 catalog_manager.cc:5495] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131). New cstate: current_term: 1 leader_uuid: "6f3b6859948840179d9e3dc8e74bf508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } health_report { overall_health: HEALTHY } } }
I20260812 06:57:30.813932 23122 raft_consensus.cc:729] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 351850ad65824ee3a095867691310369, State: Initialized, Role: FOLLOWER
I20260812 06:57:30.814503 23122 consensus_queue.cc:260] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:30.815680 23122 ts_tablet_manager.cc:1428] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:57:30.858911 22383 raft_consensus.cc:1261] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Refusing update from remote peer 6f3b6859948840179d9e3dc8e74bf508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:30.858989 22632 raft_consensus.cc:3037] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:30.859808 23100 consensus_queue.cc:1035] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:30.864485 22632 raft_consensus.cc:1261] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Refusing update from remote peer 6f3b6859948840179d9e3dc8e74bf508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:30.865383 23100 consensus_queue.cc:1035] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:30.874168 23077 mvcc.cc:205] Tried to move back new op lower bound from 7317577117105307648 to 7317577116903354368. Current Snapshot: MvccSnapshot[applied={T|T < 7317577117105307648}]
I20260812 06:57:30.893371 23078 mvcc.cc:205] Tried to move back new op lower bound from 7317577117105307648 to 7317577116903354368. Current Snapshot: MvccSnapshot[applied={T|T < 7317577117105307648}]
W20260812 06:57:30.916031 23077 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 06:57:32.577252 22060 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:32.577502 22060 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:32.582525 22060 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619: Sending DeleteTablet for 3 replicas of tablet 48225d0f68f546a487424c3f8757e115
I20260812 06:57:32.584203 22595 tablet_service.cc:1514] Processing DeleteTablet for tablet 48225d0f68f546a487424c3f8757e115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:32 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:53036
I20260812 06:57:32.584177 22332 tablet_service.cc:1514] Processing DeleteTablet for tablet 48225d0f68f546a487424c3f8757e115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:32 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:53328
I20260812 06:57:32.584199 22862 tablet_service.cc:1514] Processing DeleteTablet for tablet 48225d0f68f546a487424c3f8757e115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:32 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:38724
I20260812 06:57:32.585439 23174 tablet_replica.cc:330] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369: stopping tablet replica
I20260812 06:57:32.585858 23174 raft_consensus.cc:2229] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:32.586404 23174 raft_consensus.cc:2258] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:32.587177 23178 tablet_replica.cc:330] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e: stopping tablet replica
I20260812 06:57:32.587872 23176 tablet_replica.cc:330] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508: stopping tablet replica
I20260812 06:57:32.588253 23174 ts_tablet_manager.cc:1905] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:32.588616 23176 raft_consensus.cc:2229] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:57:32.588238 23178 raft_consensus.cc:2229] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:32.589566 23176 raft_consensus.cc:2258] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:32.590238 23178 raft_consensus.cc:2258] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:32.591646 23178 ts_tablet_manager.cc:1905] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:32.592033 23176 ts_tablet_manager.cc:1905] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:32.596879 23174 ts_tablet_manager.cc:1918] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:57:32.597110 23174 log.cc:1196] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/48225d0f68f546a487424c3f8757e115
I20260812 06:57:32.597692 23174 ts_tablet_manager.cc:1939] T 48225d0f68f546a487424c3f8757e115 P 351850ad65824ee3a095867691310369: Deleting consensus metadata
I20260812 06:57:32.599717 23178 ts_tablet_manager.cc:1918] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:57:32.599925 23178 log.cc:1196] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/48225d0f68f546a487424c3f8757e115
I20260812 06:57:32.600515 23178 ts_tablet_manager.cc:1939] T 48225d0f68f546a487424c3f8757e115 P a4df4de6e6aa4604887d506e58f9352e: Deleting consensus metadata
I20260812 06:57:32.600793 22032 catalog_manager.cc:4841] TS 351850ad65824ee3a095867691310369 (127.18.70.130:46333): tablet 48225d0f68f546a487424c3f8757e115 (table test-table [id=9672d599ba464ed393ac4a33ff62d27f]) successfully deleted
I20260812 06:57:32.601665 23176 ts_tablet_manager.cc:1918] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:57:32.601822 23176 log.cc:1196] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/48225d0f68f546a487424c3f8757e115
I20260812 06:57:32.602170 22033 catalog_manager.cc:4841] TS a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837): tablet 48225d0f68f546a487424c3f8757e115 (table test-table [id=9672d599ba464ed393ac4a33ff62d27f]) successfully deleted
I20260812 06:57:32.602380 23176 ts_tablet_manager.cc:1939] T 48225d0f68f546a487424c3f8757e115 P 6f3b6859948840179d9e3dc8e74bf508: Deleting consensus metadata
I20260812 06:57:32.603747 22035 catalog_manager.cc:4841] TS 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131:46489): tablet 48225d0f68f546a487424c3f8757e115 (table test-table [id=9672d599ba464ed393ac4a33ff62d27f]) successfully deleted
Aug 12 06:57:32 dist-test-slave-tc2s krb5kdc[21964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517852, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:57:32 dist-test-slave-tc2s krb5kdc[21964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517852, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:32.658038 23187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:32.641294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42318 (local address 127.18.70.190:43433)
0812 06:57:32.642035 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:32.642041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:32.642070 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:57:32.642144 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:32.642148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:32.642217 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:32.642318 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:32.643762 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:32.644573 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:32.645990 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:32.646480 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:32.646604 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:32.651815 (+ 5211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:32.651821 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:32.651825 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:32.651864 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:32.655004 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:32.655782 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:32.655786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:32.655789 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:32.655938 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:32.656334 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:32.656337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:32.656340 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:32.656674 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:32.656944 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:32.657290 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 06:57:32.657614 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":330,"threads_started":1}
I20260812 06:57:32.661861 22060 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42318:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:57:32.662704 22060 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:57:32.671828 22595 tablet_service.cc:1467] Processing CreateTablet for tablet 4b306d7576fd4c5b85a9f6d3b27dbe77 (DEFAULT_TABLE table=test-table [id=bbaa1a938b0b4ab1858fdab3f2c19f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:32.671813 22332 tablet_service.cc:1467] Processing CreateTablet for tablet 4b306d7576fd4c5b85a9f6d3b27dbe77 (DEFAULT_TABLE table=test-table [id=bbaa1a938b0b4ab1858fdab3f2c19f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:32.672509 22332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b306d7576fd4c5b85a9f6d3b27dbe77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:32.672645 22595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b306d7576fd4c5b85a9f6d3b27dbe77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:32.672446 22862 tablet_service.cc:1467] Processing CreateTablet for tablet 4b306d7576fd4c5b85a9f6d3b27dbe77 (DEFAULT_TABLE table=test-table [id=bbaa1a938b0b4ab1858fdab3f2c19f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:32.673074 22862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b306d7576fd4c5b85a9f6d3b27dbe77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:32.680043 23188 tablet_bootstrap.cc:492] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e: Bootstrap starting.
I20260812 06:57:32.681869 23188 tablet_bootstrap.cc:654] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:32.682535 23189 tablet_bootstrap.cc:492] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508: Bootstrap starting.
I20260812 06:57:32.684743 23189 tablet_bootstrap.cc:654] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:32.684934 23193 tablet_bootstrap.cc:492] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369: Bootstrap starting.
I20260812 06:57:32.685801 23188 tablet_bootstrap.cc:492] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e: No bootstrap required, opened a new log
I20260812 06:57:32.686012 23188 ts_tablet_manager.cc:1397] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260812 06:57:32.686793 23193 tablet_bootstrap.cc:654] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:32.687384 23188 raft_consensus.cc:348] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:32.687891 23188 raft_consensus.cc:374] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:32.688042 23188 raft_consensus.cc:729] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4df4de6e6aa4604887d506e58f9352e, State: Initialized, Role: FOLLOWER
I20260812 06:57:32.688344 23189 tablet_bootstrap.cc:492] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508: No bootstrap required, opened a new log
I20260812 06:57:32.688364 23188 consensus_queue.cc:260] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:32.688527 23189 ts_tablet_manager.cc:1397] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 06:57:32.689311 23188 ts_tablet_manager.cc:1428] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:32.689452 23189 raft_consensus.cc:348] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:32.689738 23189 raft_consensus.cc:374] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:32.689837 23189 raft_consensus.cc:729] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3b6859948840179d9e3dc8e74bf508, State: Initialized, Role: FOLLOWER
I20260812 06:57:32.690155 23189 consensus_queue.cc:260] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:32.690742 23189 ts_tablet_manager.cc:1428] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:57:32.691403 23193 tablet_bootstrap.cc:492] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369: No bootstrap required, opened a new log
I20260812 06:57:32.691601 23193 ts_tablet_manager.cc:1397] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260812 06:57:32.692550 23193 raft_consensus.cc:348] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:32.692842 23193 raft_consensus.cc:374] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:32.692951 23193 raft_consensus.cc:729] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 351850ad65824ee3a095867691310369, State: Initialized, Role: FOLLOWER
I20260812 06:57:32.693224 23193 consensus_queue.cc:260] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:32.693938 23193 ts_tablet_manager.cc:1428] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:57:32.925280 23164 raft_consensus.cc:482] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:57:32.925570 23164 raft_consensus.cc:504] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:32.926373 23164 leader_election.cc:288] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837), 351850ad65824ee3a095867691310369 (127.18.70.130:46333)
I20260812 06:57:32.927356 22384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b306d7576fd4c5b85a9f6d3b27dbe77" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4df4de6e6aa4604887d506e58f9352e" is_pre_election: true
I20260812 06:57:32.927381 22631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b306d7576fd4c5b85a9f6d3b27dbe77" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "351850ad65824ee3a095867691310369" is_pre_election: true
I20260812 06:57:32.927639 22631 raft_consensus.cc:2454] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3b6859948840179d9e3dc8e74bf508 in term 0.
I20260812 06:57:32.927762 22384 raft_consensus.cc:2454] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3b6859948840179d9e3dc8e74bf508 in term 0.
I20260812 06:57:32.928260 22782 leader_election.cc:302] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 351850ad65824ee3a095867691310369, 6f3b6859948840179d9e3dc8e74bf508; no voters:
I20260812 06:57:32.928578 23164 raft_consensus.cc:2781] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:57:32.928704 23164 raft_consensus.cc:482] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:57:32.928802 23164 raft_consensus.cc:3037] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:32.931389 23164 raft_consensus.cc:504] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:32.932060 23164 leader_election.cc:288] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 election: Requested vote from peers a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837), 351850ad65824ee3a095867691310369 (127.18.70.130:46333)
I20260812 06:57:32.932597 22384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b306d7576fd4c5b85a9f6d3b27dbe77" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4df4de6e6aa4604887d506e58f9352e"
I20260812 06:57:32.932633 22631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b306d7576fd4c5b85a9f6d3b27dbe77" candidate_uuid: "6f3b6859948840179d9e3dc8e74bf508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "351850ad65824ee3a095867691310369"
I20260812 06:57:32.932813 22631 raft_consensus.cc:3037] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:32.932821 22384 raft_consensus.cc:3037] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:32.935030 22384 raft_consensus.cc:2454] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3b6859948840179d9e3dc8e74bf508 in term 1.
I20260812 06:57:32.935109 22631 raft_consensus.cc:2454] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3b6859948840179d9e3dc8e74bf508 in term 1.
I20260812 06:57:32.935469 22783 leader_election.cc:302] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3b6859948840179d9e3dc8e74bf508, a4df4de6e6aa4604887d506e58f9352e; no voters:
I20260812 06:57:32.935781 23164 raft_consensus.cc:2781] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:32.935943 23164 raft_consensus.cc:686] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 LEADER]: Becoming Leader. State: Replica: 6f3b6859948840179d9e3dc8e74bf508, State: Running, Role: LEADER
I20260812 06:57:32.936264 23164 consensus_queue.cc:237] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:32.940614 22059 catalog_manager.cc:5495] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131). New cstate: current_term: 1 leader_uuid: "6f3b6859948840179d9e3dc8e74bf508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } health_report { overall_health: HEALTHY } } }
I20260812 06:57:32.999250 23208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:32.992507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50582 (local address 127.18.70.131:46489)
0812 06:57:32.993269 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:32.993274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:32.993301 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:57:32.993385 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:32.993389 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:32.993471 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:32.993579 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:32.994234 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:32.995163 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:32.997146 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:32.997662 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:32.997808 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:32.998428 (+ 620us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:32.998557 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:32.998638 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:32.998808 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 06:57:32.998900 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":433,"threads_started":1}
I20260812 06:57:33.012065 22631 raft_consensus.cc:1261] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Refusing update from remote peer 6f3b6859948840179d9e3dc8e74bf508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:33.012279 22384 raft_consensus.cc:1261] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Refusing update from remote peer 6f3b6859948840179d9e3dc8e74bf508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:33.012701 23164 consensus_queue.cc:1035] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:33.013052 23156 consensus_queue.cc:1035] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:33.060808 22059 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:33.061138 22059 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:33.064953 22059 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619: Sending DeleteTablet for 3 replicas of tablet 4b306d7576fd4c5b85a9f6d3b27dbe77
I20260812 06:57:33.065949 22595 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b306d7576fd4c5b85a9f6d3b27dbe77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:33 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:53036
I20260812 06:57:33.065953 22332 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b306d7576fd4c5b85a9f6d3b27dbe77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:33 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:53328
I20260812 06:57:33.066045 22862 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b306d7576fd4c5b85a9f6d3b27dbe77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:33 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:38724
I20260812 06:57:33.066274 23174 tablet_replica.cc:330] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369: stopping tablet replica
I20260812 06:57:33.066277 23178 tablet_replica.cc:330] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e: stopping tablet replica
I20260812 06:57:33.066498 23174 raft_consensus.cc:2229] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:33.066537 23176 tablet_replica.cc:330] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508: stopping tablet replica
I20260812 06:57:33.066735 23174 raft_consensus.cc:2258] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:33.066735 23176 raft_consensus.cc:2229] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:57:33.066687 23178 raft_consensus.cc:2229] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:33.067018 23178 raft_consensus.cc:2258] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:33.067067 23176 raft_consensus.cc:2258] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:33.067770 22059 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42318:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 06:57:33.068106 23174 ts_tablet_manager.cc:1905] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:33.068403 23178 ts_tablet_manager.cc:1905] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:33.068405 23176 ts_tablet_manager.cc:1905] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 06:57:33.068449 22059 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:57:33.075023 23174 ts_tablet_manager.cc:1918] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:57:33.075189 23174 log.cc:1196] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/4b306d7576fd4c5b85a9f6d3b27dbe77
I20260812 06:57:33.075654 23174 ts_tablet_manager.cc:1939] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 351850ad65824ee3a095867691310369: Deleting consensus metadata
I20260812 06:57:33.075805 23178 ts_tablet_manager.cc:1918] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:57:33.075997 23178 log.cc:1196] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/4b306d7576fd4c5b85a9f6d3b27dbe77
I20260812 06:57:33.076388 23178 ts_tablet_manager.cc:1939] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P a4df4de6e6aa4604887d506e58f9352e: Deleting consensus metadata
I20260812 06:57:33.076798 22032 catalog_manager.cc:4841] TS 351850ad65824ee3a095867691310369 (127.18.70.130:46333): tablet 4b306d7576fd4c5b85a9f6d3b27dbe77 (table test-table [id=bbaa1a938b0b4ab1858fdab3f2c19f29]) successfully deleted
I20260812 06:57:33.077533 22033 catalog_manager.cc:4841] TS a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837): tablet 4b306d7576fd4c5b85a9f6d3b27dbe77 (table test-table [id=bbaa1a938b0b4ab1858fdab3f2c19f29]) successfully deleted
I20260812 06:57:33.078423 22332 tablet_service.cc:1467] Processing CreateTablet for tablet 73c86b1367194b61aa6d07a5407983a0 (DEFAULT_TABLE table=test-table [id=0b8f3e126ec140d89a6e2c4460107756]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:33.078637 22595 tablet_service.cc:1467] Processing CreateTablet for tablet 73c86b1367194b61aa6d07a5407983a0 (DEFAULT_TABLE table=test-table [id=0b8f3e126ec140d89a6e2c4460107756]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:33.078873 22332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c86b1367194b61aa6d07a5407983a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:33.078871 22862 tablet_service.cc:1467] Processing CreateTablet for tablet 73c86b1367194b61aa6d07a5407983a0 (DEFAULT_TABLE table=test-table [id=0b8f3e126ec140d89a6e2c4460107756]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:33.079028 22595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c86b1367194b61aa6d07a5407983a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:33.079290 22862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c86b1367194b61aa6d07a5407983a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:33.079809 23176 ts_tablet_manager.cc:1918] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:57:33.079969 23176 log.cc:1196] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/4b306d7576fd4c5b85a9f6d3b27dbe77
I20260812 06:57:33.080438 23176 ts_tablet_manager.cc:1939] T 4b306d7576fd4c5b85a9f6d3b27dbe77 P 6f3b6859948840179d9e3dc8e74bf508: Deleting consensus metadata
I20260812 06:57:33.081575 22035 catalog_manager.cc:4841] TS 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131:46489): tablet 4b306d7576fd4c5b85a9f6d3b27dbe77 (table test-table [id=bbaa1a938b0b4ab1858fdab3f2c19f29]) successfully deleted
I20260812 06:57:33.085299 23193 tablet_bootstrap.cc:492] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369: Bootstrap starting.
I20260812 06:57:33.085474 23189 tablet_bootstrap.cc:492] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508: Bootstrap starting.
I20260812 06:57:33.086627 23193 tablet_bootstrap.cc:654] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:33.086743 23189 tablet_bootstrap.cc:654] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:33.087692 23188 tablet_bootstrap.cc:492] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e: Bootstrap starting.
I20260812 06:57:33.088476 23193 tablet_bootstrap.cc:492] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369: No bootstrap required, opened a new log
I20260812 06:57:33.088634 23193 ts_tablet_manager.cc:1397] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:57:33.088932 23189 tablet_bootstrap.cc:492] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508: No bootstrap required, opened a new log
I20260812 06:57:33.089102 23189 ts_tablet_manager.cc:1397] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 06:57:33.089299 23188 tablet_bootstrap.cc:654] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:33.089402 23193 raft_consensus.cc:348] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:33.089659 23193 raft_consensus.cc:374] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:33.089740 23193 raft_consensus.cc:729] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 351850ad65824ee3a095867691310369, State: Initialized, Role: FOLLOWER
I20260812 06:57:33.089722 23189 raft_consensus.cc:348] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:33.090026 23189 raft_consensus.cc:374] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:33.090116 23189 raft_consensus.cc:729] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3b6859948840179d9e3dc8e74bf508, State: Initialized, Role: FOLLOWER
I20260812 06:57:33.090046 23193 consensus_queue.cc:260] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:33.090396 23189 consensus_queue.cc:260] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:33.090623 23193 ts_tablet_manager.cc:1428] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:57:33.090865 23189 ts_tablet_manager.cc:1428] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:57:33.092558 23188 tablet_bootstrap.cc:492] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e: No bootstrap required, opened a new log
I20260812 06:57:33.092847 23188 ts_tablet_manager.cc:1397] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 06:57:33.093829 23188 raft_consensus.cc:348] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:33.094194 23188 raft_consensus.cc:374] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:33.094269 23188 raft_consensus.cc:729] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4df4de6e6aa4604887d506e58f9352e, State: Initialized, Role: FOLLOWER
I20260812 06:57:33.094575 23188 consensus_queue.cc:260] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:33.095224 23188 ts_tablet_manager.cc:1428] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:57:33.144809 23107 raft_consensus.cc:482] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:57:33.145145 23107 raft_consensus.cc:504] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:33.145931 23107 leader_election.cc:288] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837), 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131:46489)
I20260812 06:57:33.146653 22384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c86b1367194b61aa6d07a5407983a0" candidate_uuid: "351850ad65824ee3a095867691310369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4df4de6e6aa4604887d506e58f9352e" is_pre_election: true
I20260812 06:57:33.146943 22384 raft_consensus.cc:2454] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 351850ad65824ee3a095867691310369 in term 0.
I20260812 06:57:33.146793 22892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c86b1367194b61aa6d07a5407983a0" candidate_uuid: "351850ad65824ee3a095867691310369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3b6859948840179d9e3dc8e74bf508" is_pre_election: true
I20260812 06:57:33.147219 22892 raft_consensus.cc:2454] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 351850ad65824ee3a095867691310369 in term 0.
I20260812 06:57:33.147490 22510 leader_election.cc:302] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 351850ad65824ee3a095867691310369, a4df4de6e6aa4604887d506e58f9352e; no voters:
I20260812 06:57:33.147775 23107 raft_consensus.cc:2781] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:57:33.147884 23107 raft_consensus.cc:482] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:57:33.147977 23107 raft_consensus.cc:3037] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:33.150316 23107 raft_consensus.cc:504] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:33.150882 23107 leader_election.cc:288] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [CANDIDATE]: Term 1 election: Requested vote from peers a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837), 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131:46489)
I20260812 06:57:33.151491 22384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c86b1367194b61aa6d07a5407983a0" candidate_uuid: "351850ad65824ee3a095867691310369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4df4de6e6aa4604887d506e58f9352e"
I20260812 06:57:33.151706 22384 raft_consensus.cc:3037] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:33.151693 22892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c86b1367194b61aa6d07a5407983a0" candidate_uuid: "351850ad65824ee3a095867691310369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f3b6859948840179d9e3dc8e74bf508"
I20260812 06:57:33.151980 22892 raft_consensus.cc:3037] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:33.154278 22892 raft_consensus.cc:2454] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 351850ad65824ee3a095867691310369 in term 1.
I20260812 06:57:33.154491 22384 raft_consensus.cc:2454] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 351850ad65824ee3a095867691310369 in term 1.
I20260812 06:57:33.154770 22513 leader_election.cc:302] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 351850ad65824ee3a095867691310369, 6f3b6859948840179d9e3dc8e74bf508; no voters:
I20260812 06:57:33.155125 23107 raft_consensus.cc:2781] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:33.155252 23107 raft_consensus.cc:686] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 1 LEADER]: Becoming Leader. State: Replica: 351850ad65824ee3a095867691310369, State: Running, Role: LEADER
I20260812 06:57:33.155534 23107 consensus_queue.cc:237] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } }
I20260812 06:57:33.158543 22060 catalog_manager.cc:5495] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 reported cstate change: term changed from 0 to 1, leader changed from <none> to 351850ad65824ee3a095867691310369 (127.18.70.130). New cstate: current_term: 1 leader_uuid: "351850ad65824ee3a095867691310369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "351850ad65824ee3a095867691310369" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 } health_report { overall_health: UNKNOWN } } }
I20260812 06:57:33.185678 23224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:33.180382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60462 (local address 127.18.70.130:46333)
0812 06:57:33.181115 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:33.181120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:33.181140 (+ 20us) server_negotiation.cc:407] Connection header received
0812 06:57:33.181193 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:33.181197 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:33.181261 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:33.181345 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:33.181680 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:33.182519 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:33.183910 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:33.184326 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:33.184464 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:33.184900 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:33.185028 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:33.185103 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:33.185259 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 06:57:33.185334 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":447,"threads_started":1}
I20260812 06:57:33.202507 23224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:33.196445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:45485 (local address 127.18.70.130:46333)
0812 06:57:33.196628 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:33.196632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:33.197355 (+ 723us) server_negotiation.cc:407] Connection header received
0812 06:57:33.197550 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:33.197554 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:33.197617 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:33.197692 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:33.198309 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:33.199071 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:33.200751 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:33.201200 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:33.201323 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:33.201723 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:33.201833 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:33.201951 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:33.202066 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 06:57:33.202169 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":55}
I20260812 06:57:33.202603 23231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:33.196463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:46333 (local address 127.18.70.130:45485)
0812 06:57:33.197214 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:33.197233 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:33.197414 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:33.197758 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:33.197762 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:33.197773 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:57:33.198134 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:33.198144 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:33.199279 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:33.199288 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:33.200509 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:33.200525 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:33.201405 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:33.201411 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:33.201531 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:33.201569 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:57:33.201943 (+ 374us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:57:33.201962 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 06:57:33.202041 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 06:57:33.202210 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":1,"thread_start_us":435,"threads_started":1}
I20260812 06:57:33.212991 22892 raft_consensus.cc:1261] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Refusing update from remote peer 351850ad65824ee3a095867691310369: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:33.213024 22384 raft_consensus.cc:1261] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Refusing update from remote peer 351850ad65824ee3a095867691310369: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:33.213608 23136 consensus_queue.cc:1035] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3b6859948840179d9e3dc8e74bf508" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:33.213930 23107 consensus_queue.cc:1035] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4df4de6e6aa4604887d506e58f9352e" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:57:33.234598 23134 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 06:57:34.851063 22061 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:34.851332 22061 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:34.855291 22061 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 835f02cc4cce49fbb593cba252828619: Sending DeleteTablet for 3 replicas of tablet 73c86b1367194b61aa6d07a5407983a0
I20260812 06:57:34.856073 22595 tablet_service.cc:1514] Processing DeleteTablet for tablet 73c86b1367194b61aa6d07a5407983a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:34 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:53036
I20260812 06:57:34.856096 22332 tablet_service.cc:1514] Processing DeleteTablet for tablet 73c86b1367194b61aa6d07a5407983a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:34 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:53328
I20260812 06:57:34.856204 22862 tablet_service.cc:1514] Processing DeleteTablet for tablet 73c86b1367194b61aa6d07a5407983a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:34 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:38724
I20260812 06:57:34.856765 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 22200
I20260812 06:57:34.857789 23273 tablet_replica.cc:330] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508: stopping tablet replica
I20260812 06:57:34.858018 23270 tablet_replica.cc:330] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369: stopping tablet replica
I20260812 06:57:34.858063 23273 raft_consensus.cc:2229] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:34.858278 23270 raft_consensus.cc:2229] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:57:34.858366 23273 raft_consensus.cc:2258] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:34.858920 23270 raft_consensus.cc:2258] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:34.859874 23273 ts_tablet_manager.cc:1905] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:34.859897 23270 ts_tablet_manager.cc:1905] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:34.862535 23272 tablet_replica.cc:330] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e: stopping tablet replica
I20260812 06:57:34.862790 23272 raft_consensus.cc:2229] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:34.863109 23272 raft_consensus.cc:2258] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:34.864243 23272 ts_tablet_manager.cc:1905] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:34.867358 23273 ts_tablet_manager.cc:1918] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:57:34.867542 23273 log.cc:1196] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/73c86b1367194b61aa6d07a5407983a0
I20260812 06:57:34.867755 23270 ts_tablet_manager.cc:1918] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:57:34.867957 23270 log.cc:1196] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/73c86b1367194b61aa6d07a5407983a0
I20260812 06:57:34.868041 23273 ts_tablet_manager.cc:1939] T 73c86b1367194b61aa6d07a5407983a0 P 6f3b6859948840179d9e3dc8e74bf508: Deleting consensus metadata
I20260812 06:57:34.868494 23270 ts_tablet_manager.cc:1939] T 73c86b1367194b61aa6d07a5407983a0 P 351850ad65824ee3a095867691310369: Deleting consensus metadata
I20260812 06:57:34.869258 22035 catalog_manager.cc:4841] TS 6f3b6859948840179d9e3dc8e74bf508 (127.18.70.131:46489): tablet 73c86b1367194b61aa6d07a5407983a0 (table test-table [id=0b8f3e126ec140d89a6e2c4460107756]) successfully deleted
I20260812 06:57:34.869684 22032 catalog_manager.cc:4841] TS 351850ad65824ee3a095867691310369 (127.18.70.130:46333): tablet 73c86b1367194b61aa6d07a5407983a0 (table test-table [id=0b8f3e126ec140d89a6e2c4460107756]) successfully deleted
I20260812 06:57:34.870934 23272 ts_tablet_manager.cc:1918] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:57:34.871060 23272 log.cc:1196] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/73c86b1367194b61aa6d07a5407983a0
I20260812 06:57:34.871409 23272 ts_tablet_manager.cc:1939] T 73c86b1367194b61aa6d07a5407983a0 P a4df4de6e6aa4604887d506e58f9352e: Deleting consensus metadata
I20260812 06:57:34.872351 22033 catalog_manager.cc:4841] TS a4df4de6e6aa4604887d506e58f9352e (127.18.70.129:35837): tablet 73c86b1367194b61aa6d07a5407983a0 (table test-table [id=0b8f3e126ec140d89a6e2c4460107756]) successfully deleted
Aug 12 06:57:34 dist-test-slave-tc2s krb5kdc[21964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517852, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:57:34.885792 23277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:34.859249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56982 (local address 127.18.70.129:35837)
0812 06:57:34.866420 (+ 7171us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:34.866425 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:34.866455 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:57:34.866519 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:34.866527 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:34.866609 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:34.866741 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:34.869018 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:34.870231 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:34.871764 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:34.872280 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:34.872400 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:34.880428 (+ 8028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:34.880443 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:34.880461 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:34.880493 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:34.883392 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:34.884057 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:34.884064 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:34.884066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:34.884206 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:34.884546 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:34.884549 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:34.884551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:34.884921 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:34.885140 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:34.885370 (+ 230us) server_negotiation.cc:299] Negotiation successful
0812 06:57:34.885533 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7011,"thread_start_us":6882,"threads_started":1}
W20260812 06:57:34.886500 22456 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56982
W20260812 06:57:34.887097 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 22200: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 06:57:34.887303 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 22200
I20260812 06:57:34.913807 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 22473
Aug 12 06:57:34 dist-test-slave-tc2s krb5kdc[21964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517852, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 06:57:34.927800 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:34.914535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60472 (local address 127.18.70.130:46333)
0812 06:57:34.915000 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:34.915005 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:34.915022 (+ 17us) server_negotiation.cc:407] Connection header received
0812 06:57:34.915092 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:34.915095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:34.915163 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:34.915257 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:34.916400 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:34.917170 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:34.918379 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:34.918773 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:34.918861 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:34.922733 (+ 3872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:34.922746 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:34.922763 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:34.922792 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:34.925315 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:34.925871 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:34.925877 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:34.925879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:34.926042 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:34.926342 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:34.926345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:34.926347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:34.926701 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:34.926935 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:34.927253 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 06:57:34.927433 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":232,"threads_started":1}
W20260812 06:57:34.928439 22714 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60472
W20260812 06:57:34.929114 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 22473: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 06:57:34.929265 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 22473
I20260812 06:57:34.962230 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 22737
Aug 12 06:57:34 dist-test-slave-tc2s krb5kdc[21964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517852, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 06:57:34.978295 23281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:34.962953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50598 (local address 127.18.70.131:46489)
0812 06:57:34.963648 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:34.963653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:34.963668 (+ 15us) server_negotiation.cc:407] Connection header received
0812 06:57:34.963723 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:34.963727 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:34.963788 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:34.963886 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:34.965226 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:34.966193 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:34.967510 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:34.967906 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:34.968019 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:34.972287 (+ 4268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:34.972303 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:34.972329 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:34.972380 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:34.975566 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:34.976233 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:34.976241 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:34.976244 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:34.976407 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:34.976760 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:34.976767 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:34.976770 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:34.977113 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:34.977417 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:34.977679 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 06:57:34.977940 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":429,"threads_started":1}
W20260812 06:57:34.978977 22971 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50598
W20260812 06:57:34.979640 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 22737: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 06:57:34.979781 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 22737
I20260812 06:57:35.011449 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 21996
I20260812 06:57:35.012645 22145 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:35.128546 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 21996
2026-08-12T06:57:35Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8625 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:57:35 dist-test-slave-tc2s krb5kdc[23288](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:57:35 dist-test-slave-tc2s krb5kdc[23288](info): set up 2 sockets
Aug 12 06:57:35 dist-test-slave-tc2s krb5kdc[23288](info): commencing operation
krb5kdc: starting...
W20260812 06:57:36.381668 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:57:36 dist-test-slave-tc2s krb5kdc[23288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:57:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:57:36.573150 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:33965
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:33965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:36.894105 23313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:36.894385 23313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:36.894517 23313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:36.902025 23313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:36.902165 23313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:36.902288 23313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:36.902376 23313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:36.902439 23313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:57:36.912990 23313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:33965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:33965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:36.914389 23313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:36.915704 23313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:36.927456 23323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:36.927398 23329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:36.927366 23324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:36.928025 23313 server_base.cc:1034] running on GCE node
I20260812 06:57:36.928849 23313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:36.930225 23313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:36.931414 23313 hybrid_clock.cc:648] HybridClock initialized: now 1786517856931357 us; error 50 us; skew 500 ppm
I20260812 06:57:36.931737 23313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:36 dist-test-slave-tc2s krb5kdc[23288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517856, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:36.934687 23313 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:57:36.936089 23313 webserver.cc:460] Webserver started at http://127.18.70.190:40757/ using document root <none> and password file <none>
I20260812 06:57:36.936772 23313 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:36.936892 23313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:36.937187 23313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:36.940146 23313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "f66a1d7f7ab44673b5f36c4fa6f9f0bd"
format_stamp: "Formatted at 2026-08-12 06:57:36 on dist-test-slave-tc2s"
server_key: "5bec92c49d8bd553ae5d20647fe9fa10"
server_key_iv: "16d4eba7b0b5b683844f626f6cffcf60"
server_key_version: "encryptionkey@0"
I20260812 06:57:36.940910 23313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "f66a1d7f7ab44673b5f36c4fa6f9f0bd"
format_stamp: "Formatted at 2026-08-12 06:57:36 on dist-test-slave-tc2s"
server_key: "5bec92c49d8bd553ae5d20647fe9fa10"
server_key_iv: "16d4eba7b0b5b683844f626f6cffcf60"
server_key_version: "encryptionkey@0"
I20260812 06:57:36.945863 23313 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260812 06:57:36.949113 23344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:36.950413 23313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:36.950584 23313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "f66a1d7f7ab44673b5f36c4fa6f9f0bd"
format_stamp: "Formatted at 2026-08-12 06:57:36 on dist-test-slave-tc2s"
server_key: "5bec92c49d8bd553ae5d20647fe9fa10"
server_key_iv: "16d4eba7b0b5b683844f626f6cffcf60"
server_key_version: "encryptionkey@0"
I20260812 06:57:36.950762 23313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:36.965829 23313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:36.969509 23313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:36.969754 23313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:36.986449 23313 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:33965
I20260812 06:57:36.986472 23438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:33965 every 8 connection(s)
I20260812 06:57:36.987834 23313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:36.989367 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 23313
I20260812 06:57:36.989600 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:36.990460 18714 external_mini_cluster.cc:1428] Setting key 71c6b8eeb7a1ff7984770a4e55c3d03a
I20260812 06:57:36.992472 23439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 06:57:37 dist-test-slave-tc2s krb5kdc[23288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:37.005791 23439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd: Bootstrap starting.
I20260812 06:57:37.009166 23439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:37.010453 23439 log.cc:824] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:37.013182 23444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:36.992494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47164 (local address 127.18.70.190:33965)
0812 06:57:36.993242 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:36.993253 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:36.993292 (+ 39us) server_negotiation.cc:407] Connection header received
0812 06:57:36.994950 (+ 1658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:36.994972 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:36.995342 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:36.995663 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:36.997402 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:36.998788 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:37.000488 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:37.001110 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:37.001229 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:37.006025 (+ 4796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:37.006035 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:37.006051 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:37.006093 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:37.008990 (+ 2897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:37.009759 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:37.009766 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:37.009771 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:37.009983 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:37.010425 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:37.010428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:37.010430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:37.011035 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:37.011381 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:37.011884 (+ 503us) server_negotiation.cc:299] Negotiation successful
0812 06:57:37.012244 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":342,"threads_started":1}
I20260812 06:57:37.013417 23439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd: No bootstrap required, opened a new log
I20260812 06:57:37.021078 23439 raft_consensus.cc:348] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66a1d7f7ab44673b5f36c4fa6f9f0bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33965 } }
I20260812 06:57:37.021430 23439 raft_consensus.cc:374] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:37.021538 23439 raft_consensus.cc:729] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f66a1d7f7ab44673b5f36c4fa6f9f0bd, State: Initialized, Role: FOLLOWER
I20260812 06:57:37.022089 23439 consensus_queue.cc:260] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66a1d7f7ab44673b5f36c4fa6f9f0bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33965 } }
I20260812 06:57:37.022373 23439 raft_consensus.cc:388] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:37.022531 23439 raft_consensus.cc:482] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:37.022707 23439 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:37.024737 23439 raft_consensus.cc:504] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66a1d7f7ab44673b5f36c4fa6f9f0bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33965 } }
I20260812 06:57:37.025159 23439 leader_election.cc:302] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f66a1d7f7ab44673b5f36c4fa6f9f0bd; no voters:
I20260812 06:57:37.025676 23439 leader_election.cc:288] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:37.025803 23446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:37.026438 23446 raft_consensus.cc:686] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [term 1 LEADER]: Becoming Leader. State: Replica: f66a1d7f7ab44673b5f36c4fa6f9f0bd, State: Running, Role: LEADER
I20260812 06:57:37.026907 23446 consensus_queue.cc:237] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66a1d7f7ab44673b5f36c4fa6f9f0bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33965 } }
I20260812 06:57:37.027592 23439 sys_catalog.cc:564] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:37.029578 23447 sys_catalog.cc:455] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f66a1d7f7ab44673b5f36c4fa6f9f0bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66a1d7f7ab44673b5f36c4fa6f9f0bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33965 } } }
I20260812 06:57:37.030028 23447 sys_catalog.cc:458] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:37.030834 23459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:37.030728 23448 sys_catalog.cc:455] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f66a1d7f7ab44673b5f36c4fa6f9f0bd. Latest consensus state: current_term: 1 leader_uuid: "f66a1d7f7ab44673b5f36c4fa6f9f0bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66a1d7f7ab44673b5f36c4fa6f9f0bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33965 } } }
I20260812 06:57:37.031783 23448 sys_catalog.cc:458] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:37.036247 23459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:37.044605 23459 catalog_manager.cc:1347] Generated new cluster ID: 10014b0c3add4b3cb5be9b0daeaeb082
I20260812 06:57:37.044696 23459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:37.072726 23459 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:37.074090 23459 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:37.085078 23459 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f66a1d7f7ab44673b5f36c4fa6f9f0bd: Generated new TSK 0
I20260812 06:57:37.085870 23459 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:57:37.145430 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33965
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:37.513499 23481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:37.513788 23481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:37.513940 23481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:37.521255 23481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:37.521371 23481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:37.521531 23481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:57:37.531764 23481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:37.533161 23481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:37.534512 23481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:37.547207 23498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:37.547202 23499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:37.547142 23504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:37.548158 23481 server_base.cc:1034] running on GCE node
I20260812 06:57:37.548686 23481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:37.549544 23481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:37.550732 23481 hybrid_clock.cc:648] HybridClock initialized: now 1786517857550688 us; error 33 us; skew 500 ppm
I20260812 06:57:37.551030 23481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:37 dist-test-slave-tc2s krb5kdc[23288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517857, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:37.554005 23481 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:57:37.555406 23481 webserver.cc:460] Webserver started at http://127.18.70.129:42295/ using document root <none> and password file <none>
I20260812 06:57:37.556059 23481 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:37.556173 23481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:37.556465 23481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:37.559386 23481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "cabce11ee2fc4d32aae86c643366e960"
format_stamp: "Formatted at 2026-08-12 06:57:37 on dist-test-slave-tc2s"
server_key: "3451b83254435b885d0268e951865def"
server_key_iv: "1c908e7358a5f459d13da570ce6c58df"
server_key_version: "encryptionkey@0"
I20260812 06:57:37.560143 23481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "cabce11ee2fc4d32aae86c643366e960"
format_stamp: "Formatted at 2026-08-12 06:57:37 on dist-test-slave-tc2s"
server_key: "3451b83254435b885d0268e951865def"
server_key_iv: "1c908e7358a5f459d13da570ce6c58df"
server_key_version: "encryptionkey@0"
I20260812 06:57:37.565173 23481 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 06:57:37.568596 23514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:37.569833 23481 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 06:57:37.570020 23481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "cabce11ee2fc4d32aae86c643366e960"
format_stamp: "Formatted at 2026-08-12 06:57:37 on dist-test-slave-tc2s"
server_key: "3451b83254435b885d0268e951865def"
server_key_iv: "1c908e7358a5f459d13da570ce6c58df"
server_key_version: "encryptionkey@0"
I20260812 06:57:37.570215 23481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:37.586366 23481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:37.590292 23481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:37.590569 23481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:37.591495 23481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:37.592811 23481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:37.592891 23481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:37.593016 23481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:37.593075 23481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:37.623059 23481 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:39687
I20260812 06:57:37.623090 23722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:39687 every 8 connection(s)
I20260812 06:57:37.624375 23481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:57:37.628445 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 23481
I20260812 06:57:37.628626 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:57:37.629273 18714 external_mini_cluster.cc:1428] Setting key 1e7b92187e6971a2772842c37bac77c5
Aug 12 06:57:37 dist-test-slave-tc2s krb5kdc[23288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517857, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:37.644510 23731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:37.626815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:39415 (local address 127.18.70.190:33965)
0812 06:57:37.627258 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:37.627262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:37.628176 (+ 914us) server_negotiation.cc:407] Connection header received
0812 06:57:37.630224 (+ 2048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:37.630229 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:37.630310 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:37.630401 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:37.632062 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:37.632813 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:37.634368 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:37.634768 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:37.634881 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:37.638450 (+ 3569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:37.638457 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:37.638462 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:37.638502 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:37.641439 (+ 2937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:37.642179 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:37.642185 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:37.642188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:37.642353 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:37.642763 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:37.642768 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:37.642770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:37.643106 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:37.643245 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:37.643953 (+ 708us) server_negotiation.cc:299] Negotiation successful
0812 06:57:37.644178 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":216,"threads_started":1}
I20260812 06:57:37.645256 23734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:37.627315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:33965 (local address 127.18.70.129:39415)
0812 06:57:37.628025 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:37.628063 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:37.629931 (+ 1868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:37.630658 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:37.630666 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:37.631300 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:37.631903 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:37.631921 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:37.632961 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:37.632965 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:37.634233 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:37.634246 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:37.634991 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:37.634999 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:37.635224 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:37.635834 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:37.635857 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:37.638219 (+ 2362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:37.641568 (+ 3349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:37.641575 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:37.641588 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:37.642053 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:37.642457 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:37.642460 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:37.642462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:37.642653 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:37.643205 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:37.643210 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:37.643540 (+ 330us) client_negotiation.cc:769] Sending connection context
0812 06:57:37.643754 (+ 214us) client_negotiation.cc:240] Negotiation successful
0812 06:57:37.644143 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":266,"threads_started":1}
I20260812 06:57:37.646826 23725 heartbeater.cc:347] Connected to a master server at 127.18.70.190:33965
I20260812 06:57:37.647181 23725 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:37.648131 23725 heartbeater.cc:511] Master 127.18.70.190:33965 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
I20260812 06:57:37.650475 23370 ts_manager.cc:194] Registered new tserver with Master: cabce11ee2fc4d32aae86c643366e960 (127.18.70.129:39687)
I20260812 06:57:37.651913 23370 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:39415
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 06:57:37.674840 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33965
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:37.997180 23738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:37.997471 23738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:37.997605 23738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:38.004886 23738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:38.005007 23738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:38.005162 23738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:57:38.015055 23738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:38.016317 23738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:38.017640 23738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:38.030231 23752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:38.030303 23754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:38.030252 23756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:38.031134 23738 server_base.cc:1034] running on GCE node
I20260812 06:57:38.031729 23738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:38.032637 23738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:38.033860 23738 hybrid_clock.cc:648] HybridClock initialized: now 1786517858033807 us; error 39 us; skew 500 ppm
I20260812 06:57:38.034193 23738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:38 dist-test-slave-tc2s krb5kdc[23288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517858, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:38.040095 23738 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:57:38.041528 23738 webserver.cc:460] Webserver started at http://127.18.70.130:39225/ using document root <none> and password file <none>
I20260812 06:57:38.042235 23738 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:38.042361 23738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:38.042652 23738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:38.045480 23738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "da4ca0de6f834fee90df34daa1827177"
format_stamp: "Formatted at 2026-08-12 06:57:38 on dist-test-slave-tc2s"
server_key: "deb8613962f9483d7c6ea88ccd55f101"
server_key_iv: "ddc89cdd3a9f8aca462b2f26f62ff3e8"
server_key_version: "encryptionkey@0"
I20260812 06:57:38.046267 23738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "da4ca0de6f834fee90df34daa1827177"
format_stamp: "Formatted at 2026-08-12 06:57:38 on dist-test-slave-tc2s"
server_key: "deb8613962f9483d7c6ea88ccd55f101"
server_key_iv: "ddc89cdd3a9f8aca462b2f26f62ff3e8"
server_key_version: "encryptionkey@0"
I20260812 06:57:38.051110 23738 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 06:57:38.054405 23769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:38.055686 23738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 06:57:38.055836 23738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "da4ca0de6f834fee90df34daa1827177"
format_stamp: "Formatted at 2026-08-12 06:57:38 on dist-test-slave-tc2s"
server_key: "deb8613962f9483d7c6ea88ccd55f101"
server_key_iv: "ddc89cdd3a9f8aca462b2f26f62ff3e8"
server_key_version: "encryptionkey@0"
I20260812 06:57:38.056017 23738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:38.083377 23738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:38.087772 23738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:38.088049 23738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:38.089002 23738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:38.090374 23738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:38.090453 23738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:38.090570 23738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:38.090624 23738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:38.121006 23738 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:39131
I20260812 06:57:38.121055 24020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:39131 every 8 connection(s)
I20260812 06:57:38.122284 23738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:57:38.132447 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 23738
I20260812 06:57:38.132640 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:57:38.133121 18714 external_mini_cluster.cc:1428] Setting key f4924b1348d36217564482a6e77fdb2b
Aug 12 06:57:38 dist-test-slave-tc2s krb5kdc[23288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517858, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:38.144138 23731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:38.124694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:59507 (local address 127.18.70.190:33965)
0812 06:57:38.124847 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:38.124851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:38.126004 (+ 1153us) server_negotiation.cc:407] Connection header received
0812 06:57:38.127873 (+ 1869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:38.127880 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:38.127971 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:38.128059 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:38.129614 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:38.130384 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:38.131952 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:38.132585 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:38.132739 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:38.136449 (+ 3710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:38.136454 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:38.136458 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:38.136492 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:38.140263 (+ 3771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:38.141252 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:38.141272 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:38.141275 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:38.141457 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:38.141942 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:38.141948 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:38.141951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:38.142354 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:38.142512 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:38.143538 (+ 1026us) server_negotiation.cc:299] Negotiation successful
0812 06:57:38.143789 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 06:57:38.146191 24027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:38.125140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:33965 (local address 127.18.70.130:59507)
0812 06:57:38.125823 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:38.125867 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:38.127595 (+ 1728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:38.128289 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:38.128297 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:38.128896 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:38.129445 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:38.129463 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:38.130547 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:38.130551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:38.131806 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:38.131824 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:38.132825 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:38.132841 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:38.133036 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:38.133690 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:38.133720 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:38.136200 (+ 2480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:38.140465 (+ 4265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:38.140474 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:38.140500 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:38.141111 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:38.141570 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:38.141575 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:38.141578 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:38.141811 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:38.142588 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:38.142597 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:38.143041 (+ 444us) client_negotiation.cc:769] Sending connection context
0812 06:57:38.144352 (+ 1311us) client_negotiation.cc:240] Negotiation successful
0812 06:57:38.144939 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":273,"threads_started":1}
I20260812 06:57:38.148993 24022 heartbeater.cc:347] Connected to a master server at 127.18.70.190:33965
I20260812 06:57:38.149341 24022 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:38.150231 24022 heartbeater.cc:511] Master 127.18.70.190:33965 requested a full tablet report, sending...
I20260812 06:57:38.153237 23370 ts_manager.cc:194] Registered new tserver with Master: da4ca0de6f834fee90df34daa1827177 (127.18.70.130:39131)
I20260812 06:57:38.154414 23370 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:59507
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 06:57:38.187562 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33965
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:38.531519 24033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:38.531804 24033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:38.531944 24033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:38.539817 24033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:38.539942 24033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:38.540124 24033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:57:38.550480 24033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:38.551851 24033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:38.553174 24033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:38.566497 24041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:38.566551 24042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:38.566599 24045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:38.567662 24033 server_base.cc:1034] running on GCE node
I20260812 06:57:38.568256 24033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:38.569177 24033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:38.570389 24033 hybrid_clock.cc:648] HybridClock initialized: now 1786517858570335 us; error 48 us; skew 500 ppm
I20260812 06:57:38.570715 24033 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:38 dist-test-slave-tc2s krb5kdc[23288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517858, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:38.574093 24033 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:57:38.575659 24033 webserver.cc:460] Webserver started at http://127.18.70.131:44721/ using document root <none> and password file <none>
I20260812 06:57:38.576328 24033 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:38.576445 24033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:38.576707 24033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:38.579766 24033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "fb050b940d824af5a49fcda6caf96034"
format_stamp: "Formatted at 2026-08-12 06:57:38 on dist-test-slave-tc2s"
server_key: "edb2a1efdc0a840fd01e0a98cac23d1e"
server_key_iv: "6da6ab405935f9153c220b698f35351d"
server_key_version: "encryptionkey@0"
I20260812 06:57:38.580572 24033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "fb050b940d824af5a49fcda6caf96034"
format_stamp: "Formatted at 2026-08-12 06:57:38 on dist-test-slave-tc2s"
server_key: "edb2a1efdc0a840fd01e0a98cac23d1e"
server_key_iv: "6da6ab405935f9153c220b698f35351d"
server_key_version: "encryptionkey@0"
I20260812 06:57:38.585930 24033 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260812 06:57:38.589443 24055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:38.590816 24033 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 06:57:38.590968 24033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "fb050b940d824af5a49fcda6caf96034"
format_stamp: "Formatted at 2026-08-12 06:57:38 on dist-test-slave-tc2s"
server_key: "edb2a1efdc0a840fd01e0a98cac23d1e"
server_key_iv: "6da6ab405935f9153c220b698f35351d"
server_key_version: "encryptionkey@0"
I20260812 06:57:38.591157 24033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:38.607059 24033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:38.611233 24033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:38.611529 24033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:38.612551 24033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:38.613967 24033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:38.614048 24033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:38.614172 24033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:38.614231 24033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:38.646812 24033 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:40161
I20260812 06:57:38.646844 24296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:40161 every 8 connection(s)
I20260812 06:57:38.648138 24033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:57:38.651440 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 24033
I20260812 06:57:38.651624 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:57:38.652244 18714 external_mini_cluster.cc:1428] Setting key c7988bc5f620ae25fa3420b2e0e81734
I20260812 06:57:38.654911 23725 heartbeater.cc:503] Master 127.18.70.190:33965 was elected leader, sending a full tablet report...
Aug 12 06:57:38 dist-test-slave-tc2s krb5kdc[23288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517858, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:38.668881 24303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:38.650678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:34905 (local address 127.18.70.190:33965)
0812 06:57:38.651198 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:38.651206 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:38.652259 (+ 1053us) server_negotiation.cc:407] Connection header received
0812 06:57:38.654748 (+ 2489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:38.654753 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:38.654839 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:38.654995 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:38.657012 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:38.657810 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:38.659337 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:38.659780 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:38.659882 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:38.663257 (+ 3375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:38.663262 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:38.663270 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:38.663307 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:38.665774 (+ 2467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:38.666603 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:38.666607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:38.666609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:38.666741 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:38.667171 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:38.667174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:38.667176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:38.667548 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:38.667666 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:38.668444 (+ 778us) server_negotiation.cc:299] Negotiation successful
0812 06:57:38.668612 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":220,"threads_started":1}
I20260812 06:57:38.669858 24304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:38.651232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:33965 (local address 127.18.70.131:34905)
0812 06:57:38.652097 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:38.652147 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:38.654447 (+ 2300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:38.655275 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:38.655286 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:38.656049 (+ 763us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:38.656833 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:38.656855 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:38.657985 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:38.657990 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:38.659221 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:38.659233 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:38.659957 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:38.659962 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:38.660171 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:38.660834 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:38.660857 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:38.663049 (+ 2192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:38.665942 (+ 2893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:38.665952 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:38.665967 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:38.666480 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:38.666853 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:38.666857 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:38.666861 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:38.667067 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:38.667673 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:38.667681 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:38.668094 (+ 413us) client_negotiation.cc:769] Sending connection context
0812 06:57:38.668330 (+ 236us) client_negotiation.cc:240] Negotiation successful
0812 06:57:38.668724 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":333,"threads_started":1}
I20260812 06:57:38.671132 24300 heartbeater.cc:347] Connected to a master server at 127.18.70.190:33965
I20260812 06:57:38.671420 24300 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:38.672164 24300 heartbeater.cc:511] Master 127.18.70.190:33965 requested a full tablet report, sending...
I20260812 06:57:38.673527 23370 ts_manager.cc:194] Registered new tserver with Master: fb050b940d824af5a49fcda6caf96034 (127.18.70.131:40161)
I20260812 06:57:38.674410 23370 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:34905
I20260812 06:57:38.680260 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:57:38.716195 24303 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:57:38.713676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47178 (local address 127.18.70.190:33965)
0812 06:57:38.713882 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:38.713912 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:38.714320 (+ 408us) server_negotiation.cc:407] Connection header received
0812 06:57:38.714506 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:38.714510 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:38.714580 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:38.714666 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:38.715989 (+ 1323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47178: BlockingRecv error: recv got EOF from 127.0.0.1:47178 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 06:57:38.719298 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 23481
W20260812 06:57:38.722018 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 23481: Not authorized: Client connection negotiation failed: client connection to 127.18.70.129:39687: server requires authentication, but client does not have Kerberos credentials available
I20260812 06:57:38.722223 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 23481
I20260812 06:57:38.744453 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 23738
W20260812 06:57:38.747097 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 23738: Not authorized: Client connection negotiation failed: client connection to 127.18.70.130:39131: server requires authentication, but client does not have Kerberos credentials available
I20260812 06:57:38.747212 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 23738
I20260812 06:57:38.779731 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24033
W20260812 06:57:38.782622 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24033: Not authorized: Client connection negotiation failed: client connection to 127.18.70.131:40161: server requires authentication, but client does not have Kerberos credentials available
I20260812 06:57:38.782802 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 24033
I20260812 06:57:38.805311 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 23313
I20260812 06:57:38.806692 23430 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:38.912631 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 23313
2026-08-12T06:57:38Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3785 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:57:39 dist-test-slave-tc2s krb5kdc[24328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:57:39 dist-test-slave-tc2s krb5kdc[24328](info): set up 2 sockets
Aug 12 06:57:39 dist-test-slave-tc2s krb5kdc[24328](info): commencing operation
krb5kdc: starting...
W20260812 06:57:40.218655 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.005s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:57:40 dist-test-slave-tc2s krb5kdc[24328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:57:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:57:40.466409 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:38161
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:43893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:38161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:40.832753 24360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:40.833073 24360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:40.833213 24360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:40.840631 24360 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:40.840759 24360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:40.840808 24360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:40.840896 24360 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:40.840947 24360 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:57:40.851034 24360 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:43893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:38161
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:38161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:40.852476 24360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:40.853802 24360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:40.865959 24374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:40.866011 24379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:40.865908 24370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:40.866742 24360 server_base.cc:1034] running on GCE node
I20260812 06:57:40.867590 24360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:40.869055 24360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:40.870301 24360 hybrid_clock.cc:648] HybridClock initialized: now 1786517860870254 us; error 29 us; skew 500 ppm
I20260812 06:57:40.870744 24360 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:40 dist-test-slave-tc2s krb5kdc[24328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517860, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:40.879081 24360 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:57:40.881269 24360 webserver.cc:460] Webserver started at http://127.18.70.190:39039/ using document root <none> and password file <none>
I20260812 06:57:40.882246 24360 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:40.882380 24360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:40.882946 24360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:40.886956 24360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "4792094158b547c0bb7df2030f80e1e2"
format_stamp: "Formatted at 2026-08-12 06:57:40 on dist-test-slave-tc2s"
server_key: "092e854e61d067dc09ca952ad89ed09a"
server_key_iv: "83725c6964a255c44642cdc9c3d54687"
server_key_version: "encryptionkey@0"
I20260812 06:57:40.887888 24360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "4792094158b547c0bb7df2030f80e1e2"
format_stamp: "Formatted at 2026-08-12 06:57:40 on dist-test-slave-tc2s"
server_key: "092e854e61d067dc09ca952ad89ed09a"
server_key_iv: "83725c6964a255c44642cdc9c3d54687"
server_key_version: "encryptionkey@0"
I20260812 06:57:40.895462 24360 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260812 06:57:40.899864 24394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:40.901949 24360 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260812 06:57:40.902215 24360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "4792094158b547c0bb7df2030f80e1e2"
format_stamp: "Formatted at 2026-08-12 06:57:40 on dist-test-slave-tc2s"
server_key: "092e854e61d067dc09ca952ad89ed09a"
server_key_iv: "83725c6964a255c44642cdc9c3d54687"
server_key_version: "encryptionkey@0"
I20260812 06:57:40.902477 24360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:40.917377 24360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:40.922227 24360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:40.922510 24360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:40.941677 24360 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:38161
I20260812 06:57:40.941735 24499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:38161 every 8 connection(s)
I20260812 06:57:40.943193 24360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:40.947168 24501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:40.952721 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 24360
I20260812 06:57:40.953006 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:40.953787 18714 external_mini_cluster.cc:1428] Setting key 2304af644bfa4df623e0bf00f2b4fab0
I20260812 06:57:40.958600 24501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2: Bootstrap starting.
I20260812 06:57:40.962612 24501 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:40.963774 24501 log.cc:824] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:40.966991 24501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2: No bootstrap required, opened a new log
Aug 12 06:57:40 dist-test-slave-tc2s krb5kdc[24328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:40.976775 24501 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4792094158b547c0bb7df2030f80e1e2" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38161 } }
I20260812 06:57:40.977244 24501 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:40.977355 24501 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4792094158b547c0bb7df2030f80e1e2, State: Initialized, Role: FOLLOWER
I20260812 06:57:40.978076 24501 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4792094158b547c0bb7df2030f80e1e2" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38161 } }
I20260812 06:57:40.978333 24501 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:40.978515 24501 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:40.978724 24501 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:40.980659 24506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:40.956486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47882 (local address 127.18.70.190:38161)
0812 06:57:40.957434 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:40.957449 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:40.957502 (+ 53us) server_negotiation.cc:407] Connection header received
0812 06:57:40.959718 (+ 2216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:40.959748 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:40.960227 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:40.960648 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:40.962908 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:40.964486 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:40.966174 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:40.966886 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:40.967030 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:40.971949 (+ 4919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:40.971959 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:40.971977 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:40.972042 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:40.975850 (+ 3808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:40.976766 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:40.976774 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:40.976782 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:40.976971 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:40.977449 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:40.977454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:40.977457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:40.978236 (+ 779us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:40.978544 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:40.979062 (+ 518us) server_negotiation.cc:299] Negotiation successful
0812 06:57:40.979514 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":421,"threads_started":1}
I20260812 06:57:40.981384 24501 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4792094158b547c0bb7df2030f80e1e2" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38161 } }
I20260812 06:57:40.981933 24501 leader_election.cc:302] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4792094158b547c0bb7df2030f80e1e2; no voters:
I20260812 06:57:40.982547 24501 leader_election.cc:288] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:40.982713 24509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:40.984318 24509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [term 1 LEADER]: Becoming Leader. State: Replica: 4792094158b547c0bb7df2030f80e1e2, State: Running, Role: LEADER
I20260812 06:57:40.984867 24501 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:40.984953 24509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4792094158b547c0bb7df2030f80e1e2" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38161 } }
I20260812 06:57:40.985443 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:57:40.992375 24513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4792094158b547c0bb7df2030f80e1e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4792094158b547c0bb7df2030f80e1e2" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38161 } } }
I20260812 06:57:40.993328 24513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:40.993029 24514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4792094158b547c0bb7df2030f80e1e2. Latest consensus state: current_term: 1 leader_uuid: "4792094158b547c0bb7df2030f80e1e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4792094158b547c0bb7df2030f80e1e2" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38161 } } }
I20260812 06:57:40.993880 24514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:40.998234 24523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:41.010295 24523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:41.024374 24523 catalog_manager.cc:1347] Generated new cluster ID: a4f25fde5fff40e3a3592f22e80e8ac0
I20260812 06:57:41.024501 24523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:41.036945 24523 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:41.038470 24523 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:41.055385 24523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4792094158b547c0bb7df2030f80e1e2: Generated new TSK 0
I20260812 06:57:41.056824 24523 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:57:41.057781 24506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:41.047807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47890 (local address 127.18.70.190:38161)
0812 06:57:41.047998 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:41.048004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:41.048882 (+ 878us) server_negotiation.cc:407] Connection header received
0812 06:57:41.049100 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:41.049107 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:41.049229 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:41.049386 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:41.050773 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:41.052110 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:41.053948 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:41.054611 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:41.054742 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:41.056102 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:41.056107 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:41.056111 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:41.056828 (+ 717us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:41.056931 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:41.056982 (+ 51us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:41.057097 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:41.057248 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 06:57:41.057363 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 06:57:41.064769 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24360
I20260812 06:57:41.066540 24493 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:41.158223 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 24360
2026-08-12T06:57:41Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2250 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:57:41 dist-test-slave-tc2s krb5kdc[24564](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:57:41 dist-test-slave-tc2s krb5kdc[24564](info): set up 2 sockets
Aug 12 06:57:41 dist-test-slave-tc2s krb5kdc[24564](info): commencing operation
krb5kdc: starting...
W20260812 06:57:42.423358 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.003s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:57:42 dist-test-slave-tc2s krb5kdc[24564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:57:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:57:42.619745 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36125
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:36125
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:42.944120 24586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:42.944409 24586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:42.944540 24586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:42.951792 24586 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:42.951890 24586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:42.951964 24586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:42.952036 24586 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:42.952099 24586 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:57:42.962122 24586 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:36125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:42.963374 24586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:42.964681 24586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:42.975601 24597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:42.975703 24607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:42.975849 24611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:42.976641 24586 server_base.cc:1034] running on GCE node
I20260812 06:57:42.977336 24586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:42.978653 24586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:42.979852 24586 hybrid_clock.cc:648] HybridClock initialized: now 1786517862979806 us; error 34 us; skew 500 ppm
I20260812 06:57:42.980155 24586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:42 dist-test-slave-tc2s krb5kdc[24564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517862, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:42.983220 24586 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:57:42.984582 24586 webserver.cc:460] Webserver started at http://127.18.70.190:32795/ using document root <none> and password file <none>
I20260812 06:57:42.985224 24586 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:42.985339 24586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:42.985633 24586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:42.988583 24586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "aa98b2ae2e6b4347bce867eebedf5d86"
format_stamp: "Formatted at 2026-08-12 06:57:42 on dist-test-slave-tc2s"
server_key: "e7c6ff3e609a555818e1bf3bba6166f6"
server_key_iv: "fe1f48c4d5966bc88d91d76f7862a65c"
server_key_version: "encryptionkey@0"
I20260812 06:57:42.989331 24586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "aa98b2ae2e6b4347bce867eebedf5d86"
format_stamp: "Formatted at 2026-08-12 06:57:42 on dist-test-slave-tc2s"
server_key: "e7c6ff3e609a555818e1bf3bba6166f6"
server_key_iv: "fe1f48c4d5966bc88d91d76f7862a65c"
server_key_version: "encryptionkey@0"
I20260812 06:57:42.994215 24586 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260812 06:57:42.997455 24621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:42.998694 24586 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:42.998844 24586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "aa98b2ae2e6b4347bce867eebedf5d86"
format_stamp: "Formatted at 2026-08-12 06:57:42 on dist-test-slave-tc2s"
server_key: "e7c6ff3e609a555818e1bf3bba6166f6"
server_key_iv: "fe1f48c4d5966bc88d91d76f7862a65c"
server_key_version: "encryptionkey@0"
I20260812 06:57:42.999017 24586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:43.011183 24586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:43.014762 24586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:43.015010 24586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:43.031493 24586 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:36125
I20260812 06:57:43.031522 24719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:36125 every 8 connection(s)
I20260812 06:57:43.032720 24586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:43.036175 24720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:43.037091 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 24586
I20260812 06:57:43.037312 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:43.037959 18714 external_mini_cluster.cc:1428] Setting key cdecd5144ab07f7232cb9511904b4cdc
I20260812 06:57:43.049595 24720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86: Bootstrap starting.
Aug 12 06:57:43 dist-test-slave-tc2s krb5kdc[24564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:43.053292 24720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:43.054488 24720 log.cc:824] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:43.057542 24720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86: No bootstrap required, opened a new log
I20260812 06:57:43.059710 24726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:43.039751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40740 (local address 127.18.70.190:36125)
0812 06:57:43.040504 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:43.040518 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:43.040560 (+ 42us) server_negotiation.cc:407] Connection header received
0812 06:57:43.042133 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:43.042154 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:43.042509 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:43.042813 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:43.044487 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:43.045699 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:43.047475 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:43.048098 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:43.048215 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:43.052946 (+ 4731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:43.052954 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:43.052968 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:43.053005 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:43.055921 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:43.056677 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:43.056683 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:43.056688 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:43.056842 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:43.057237 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:43.057240 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:43.057242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:43.057754 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:43.058034 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:43.058428 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 06:57:43.058725 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":354,"threads_started":1}
I20260812 06:57:43.065688 24720 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa98b2ae2e6b4347bce867eebedf5d86" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36125 } }
I20260812 06:57:43.066109 24720 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:43.066203 24720 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa98b2ae2e6b4347bce867eebedf5d86, State: Initialized, Role: FOLLOWER
I20260812 06:57:43.066725 24720 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa98b2ae2e6b4347bce867eebedf5d86" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36125 } }
I20260812 06:57:43.066936 24720 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:43.067070 24720 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:43.067221 24720 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:43.069407 24720 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa98b2ae2e6b4347bce867eebedf5d86" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36125 } }
I20260812 06:57:43.069861 24720 leader_election.cc:302] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa98b2ae2e6b4347bce867eebedf5d86; no voters:
I20260812 06:57:43.070415 24720 leader_election.cc:288] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:43.070537 24733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:43.071144 24733 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [term 1 LEADER]: Becoming Leader. State: Replica: aa98b2ae2e6b4347bce867eebedf5d86, State: Running, Role: LEADER
I20260812 06:57:43.071645 24733 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa98b2ae2e6b4347bce867eebedf5d86" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36125 } }
I20260812 06:57:43.072319 24720 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:43.074220 24735 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa98b2ae2e6b4347bce867eebedf5d86. Latest consensus state: current_term: 1 leader_uuid: "aa98b2ae2e6b4347bce867eebedf5d86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa98b2ae2e6b4347bce867eebedf5d86" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36125 } } }
I20260812 06:57:43.074630 24735 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:43.074519 24734 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa98b2ae2e6b4347bce867eebedf5d86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa98b2ae2e6b4347bce867eebedf5d86" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36125 } } }
I20260812 06:57:43.074792 24734 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:43.075539 24746 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:43.080852 24746 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:43.090160 24746 catalog_manager.cc:1347] Generated new cluster ID: f8450c0eb31b48c9a49aad4d4c818d56
I20260812 06:57:43.090260 24746 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:43.113117 24746 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:43.114383 24746 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:43.125025 24746 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa98b2ae2e6b4347bce867eebedf5d86: Generated new TSK 0
I20260812 06:57:43.125783 24746 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:57:43.171914 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36125
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:43.493307 24776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:43.493583 24776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:43.493705 24776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:43.500869 24776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:43.500979 24776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:43.501142 24776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:57:43.510805 24776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:43.512084 24776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:43.513396 24776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:43.525877 24784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:43.525836 24789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:43.526340 24783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:43.526849 24776 server_base.cc:1034] running on GCE node
I20260812 06:57:43.527401 24776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:43.528285 24776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:43.529475 24776 hybrid_clock.cc:648] HybridClock initialized: now 1786517863529430 us; error 40 us; skew 500 ppm
I20260812 06:57:43.529794 24776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:43 dist-test-slave-tc2s krb5kdc[24564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517863, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:43.532829 24776 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:57:43.534261 24776 webserver.cc:460] Webserver started at http://127.18.70.129:39701/ using document root <none> and password file <none>
I20260812 06:57:43.534919 24776 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:43.535039 24776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:43.535327 24776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:43.538228 24776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "69d0ca232aab4e7aa23acd5a010c8bb9"
format_stamp: "Formatted at 2026-08-12 06:57:43 on dist-test-slave-tc2s"
server_key: "0b27605f8ceaaaf801e8b7735ade433b"
server_key_iv: "4b35622072a720e3234564eba5c86d4b"
server_key_version: "encryptionkey@0"
I20260812 06:57:43.538990 24776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "69d0ca232aab4e7aa23acd5a010c8bb9"
format_stamp: "Formatted at 2026-08-12 06:57:43 on dist-test-slave-tc2s"
server_key: "0b27605f8ceaaaf801e8b7735ade433b"
server_key_iv: "4b35622072a720e3234564eba5c86d4b"
server_key_version: "encryptionkey@0"
I20260812 06:57:43.543948 24776 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 06:57:43.547246 24805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:43.548470 24776 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 06:57:43.548622 24776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "69d0ca232aab4e7aa23acd5a010c8bb9"
format_stamp: "Formatted at 2026-08-12 06:57:43 on dist-test-slave-tc2s"
server_key: "0b27605f8ceaaaf801e8b7735ade433b"
server_key_iv: "4b35622072a720e3234564eba5c86d4b"
server_key_version: "encryptionkey@0"
I20260812 06:57:43.548803 24776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:43.567569 24776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:43.571563 24776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:43.571835 24776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:43.572834 24776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:43.574235 24776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:43.574314 24776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:43.574437 24776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:43.574491 24776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:43.605016 24776 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:40633
I20260812 06:57:43.605052 25032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:40633 every 8 connection(s)
I20260812 06:57:43.606333 24776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:57:43.609417 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 24776
I20260812 06:57:43.609635 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:57:43.610504 18714 external_mini_cluster.cc:1428] Setting key 210d4a75a6c080d22bc29d5970f46911
Aug 12 06:57:43 dist-test-slave-tc2s krb5kdc[24564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517863, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:43.627835 25038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:43.608755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:48283 (local address 127.18.70.190:36125)
0812 06:57:43.609238 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:43.609244 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:43.610388 (+ 1144us) server_negotiation.cc:407] Connection header received
0812 06:57:43.612515 (+ 2127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:43.612519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:43.612585 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:43.612674 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:43.614614 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:43.615334 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:43.617358 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:43.617760 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:43.617849 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:43.621483 (+ 3634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:43.621489 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:43.621494 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:43.621544 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:43.624583 (+ 3039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:43.625451 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:43.625456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:43.625460 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:43.625614 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:43.626126 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:43.626131 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:43.626134 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:43.626473 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:43.626660 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:43.627259 (+ 599us) server_negotiation.cc:299] Negotiation successful
0812 06:57:43.627471 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":234,"threads_started":1}
I20260812 06:57:43.628582 25041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:43.609332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36125 (local address 127.18.70.129:48283)
0812 06:57:43.610207 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:43.610266 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:43.612221 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:43.612946 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:43.612956 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:43.613633 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:43.614436 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:43.614462 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:43.615487 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:43.615491 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:43.617235 (+ 1744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:43.617252 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:43.617988 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:43.617994 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:43.618242 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:43.618907 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:43.618939 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:43.621263 (+ 2324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:43.624759 (+ 3496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:43.624768 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:43.624783 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:43.625294 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:43.625710 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:43.625713 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:43.625715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:43.626001 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:43.626604 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:43.626610 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:43.626931 (+ 321us) client_negotiation.cc:769] Sending connection context
0812 06:57:43.627147 (+ 216us) client_negotiation.cc:240] Negotiation successful
0812 06:57:43.627514 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":305,"threads_started":1}
I20260812 06:57:43.630282 25033 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36125
I20260812 06:57:43.630558 25033 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:43.631263 25033 heartbeater.cc:511] Master 127.18.70.190:36125 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
I20260812 06:57:43.633275 24650 ts_manager.cc:194] Registered new tserver with Master: 69d0ca232aab4e7aa23acd5a010c8bb9 (127.18.70.129:40633)
I20260812 06:57:43.634744 24650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:48283
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 06:57:43.657243 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36125
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:43.975652 25046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:43.975915 25046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:43.976048 25046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:43.983145 25046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:43.983259 25046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:43.983424 25046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:57:43.992862 25046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:43.994235 25046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:43.995518 25046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:44.007918 25057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:44.007946 25059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:44.008152 25064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:44.008797 25046 server_base.cc:1034] running on GCE node
I20260812 06:57:44.009388 25046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:44.010319 25046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:44.011513 25046 hybrid_clock.cc:648] HybridClock initialized: now 1786517864011467 us; error 38 us; skew 500 ppm
I20260812 06:57:44.011806 25046 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[24564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517864, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:44.014927 25046 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:57:44.018117 25046 webserver.cc:460] Webserver started at http://127.18.70.130:40347/ using document root <none> and password file <none>
I20260812 06:57:44.018815 25046 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:44.018925 25046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:44.019220 25046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:44.022159 25046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "6a0a141701824037aefb81ab7201be47"
format_stamp: "Formatted at 2026-08-12 06:57:44 on dist-test-slave-tc2s"
server_key: "1b41dcb087deb8419bc7267bf74e0074"
server_key_iv: "7c9bd1bdd4da8069011a099ca400ed29"
server_key_version: "encryptionkey@0"
I20260812 06:57:44.022933 25046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "6a0a141701824037aefb81ab7201be47"
format_stamp: "Formatted at 2026-08-12 06:57:44 on dist-test-slave-tc2s"
server_key: "1b41dcb087deb8419bc7267bf74e0074"
server_key_iv: "7c9bd1bdd4da8069011a099ca400ed29"
server_key_version: "encryptionkey@0"
I20260812 06:57:44.027815 25046 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 06:57:44.031234 25073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:44.032621 25046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 06:57:44.032774 25046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "6a0a141701824037aefb81ab7201be47"
format_stamp: "Formatted at 2026-08-12 06:57:44 on dist-test-slave-tc2s"
server_key: "1b41dcb087deb8419bc7267bf74e0074"
server_key_iv: "7c9bd1bdd4da8069011a099ca400ed29"
server_key_version: "encryptionkey@0"
I20260812 06:57:44.032958 25046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:44.046411 25046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:44.050020 25046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:44.050285 25046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:44.051156 25046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:44.052412 25046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:44.052488 25046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:44.052601 25046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:44.052661 25046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:44.082417 25046 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:42179
I20260812 06:57:44.082458 25291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:42179 every 8 connection(s)
I20260812 06:57:44.083655 25046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:57:44.084080 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 25046
I20260812 06:57:44.084261 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:57:44.084697 18714 external_mini_cluster.cc:1428] Setting key 316bf69aadf4926bb1ed0c51dd642a5e
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[24564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517864, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:44.104007 25038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:44.086370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:41549 (local address 127.18.70.190:36125)
0812 06:57:44.086569 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:44.086575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:44.087876 (+ 1301us) server_negotiation.cc:407] Connection header received
0812 06:57:44.089617 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:44.089623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:44.089701 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:44.089784 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:44.091284 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.091994 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.093802 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.094280 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.094384 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:44.098200 (+ 3816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:44.098205 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:44.098209 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:44.098241 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:44.100756 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.101653 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.101657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.101659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.101794 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.102282 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.102286 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.102287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.102575 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:44.102720 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:44.103416 (+ 696us) server_negotiation.cc:299] Negotiation successful
0812 06:57:44.103655 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
I20260812 06:57:44.104982 25298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:44.086975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36125 (local address 127.18.70.130:41549)
0812 06:57:44.087730 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:44.087776 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:44.089371 (+ 1595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:44.090055 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:44.090063 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:44.090551 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:44.091123 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:44.091141 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.092133 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.092137 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:44.093655 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:44.093669 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.094498 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.094505 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:44.094753 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:44.095439 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:44.095468 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:44.097984 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:44.100920 (+ 2936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:44.100930 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:44.100958 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:44.101543 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:44.101913 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:44.101918 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:44.101921 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:44.102185 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:44.102701 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:44.102709 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:44.103057 (+ 348us) client_negotiation.cc:769] Sending connection context
0812 06:57:44.103290 (+ 233us) client_negotiation.cc:240] Negotiation successful
0812 06:57:44.103864 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":323,"threads_started":1}
I20260812 06:57:44.106389 25294 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36125
I20260812 06:57:44.106691 25294 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
I20260812 06:57:44.107466 25294 heartbeater.cc:511] Master 127.18.70.190:36125 requested a full tablet report, sending...
I20260812 06:57:44.109055 24650 ts_manager.cc:194] Registered new tserver with Master: 6a0a141701824037aefb81ab7201be47 (127.18.70.130:42179)
I20260812 06:57:44.110085 24650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:41549
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 06:57:44.130410 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36125
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:44.455430 25305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:44.455713 25305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:44.455839 25305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:44.462885 25305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:44.462998 25305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:44.463152 25305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:57:44.472468 25305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:44.473733 25305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:44.475008 25305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:44.487327 25311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:44.487380 25310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:44.487769 25313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:44.488091 25305 server_base.cc:1034] running on GCE node
I20260812 06:57:44.488672 25305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:44.489557 25305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:44.490747 25305 hybrid_clock.cc:648] HybridClock initialized: now 1786517864490701 us; error 38 us; skew 500 ppm
I20260812 06:57:44.491031 25305 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[24564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517864, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:44.493973 25305 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:57:44.495291 25305 webserver.cc:460] Webserver started at http://127.18.70.131:35511/ using document root <none> and password file <none>
I20260812 06:57:44.495942 25305 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:44.496057 25305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:44.496330 25305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:44.499162 25305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "e48e1e31207a43db99716443ff2ab95e"
format_stamp: "Formatted at 2026-08-12 06:57:44 on dist-test-slave-tc2s"
server_key: "d703d5d55530a86e42dd8e55ec939fcb"
server_key_iv: "6bfb304552dd41a486bf70deb157082b"
server_key_version: "encryptionkey@0"
I20260812 06:57:44.499907 25305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "e48e1e31207a43db99716443ff2ab95e"
format_stamp: "Formatted at 2026-08-12 06:57:44 on dist-test-slave-tc2s"
server_key: "d703d5d55530a86e42dd8e55ec939fcb"
server_key_iv: "6bfb304552dd41a486bf70deb157082b"
server_key_version: "encryptionkey@0"
I20260812 06:57:44.505115 25305 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 06:57:44.508538 25330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:44.509749 25305 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 06:57:44.509929 25305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "e48e1e31207a43db99716443ff2ab95e"
format_stamp: "Formatted at 2026-08-12 06:57:44 on dist-test-slave-tc2s"
server_key: "d703d5d55530a86e42dd8e55ec939fcb"
server_key_iv: "6bfb304552dd41a486bf70deb157082b"
server_key_version: "encryptionkey@0"
I20260812 06:57:44.510113 25305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:44.524092 25305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:44.528124 25305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:44.528393 25305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:44.529330 25305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:44.530716 25305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:44.530788 25305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:44.530915 25305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:44.530966 25305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:44.559687 25305 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:35685
I20260812 06:57:44.559700 25551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:35685 every 8 connection(s)
I20260812 06:57:44.560989 25305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:57:44.566840 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 25305
I20260812 06:57:44.567047 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:57:44.567481 18714 external_mini_cluster.cc:1428] Setting key fd29ffff7f1a824468f7a47fc6b9b5e1
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[24564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517864, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:44.580327 25038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:44.563431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:55327 (local address 127.18.70.190:36125)
0812 06:57:44.563602 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:44.563607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:44.564739 (+ 1132us) server_negotiation.cc:407] Connection header received
0812 06:57:44.566540 (+ 1801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:44.566546 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:44.566640 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:44.566760 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:44.568288 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.569334 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.571223 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.571625 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.571721 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:44.575084 (+ 3363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:44.575089 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:44.575093 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:44.575125 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:44.577661 (+ 2536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.578414 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.578418 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.578421 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.578547 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.578902 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.578905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.578907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.579188 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:44.579300 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:44.579893 (+ 593us) server_negotiation.cc:299] Negotiation successful
0812 06:57:44.580073 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 06:57:44.581360 25557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:44.563873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36125 (local address 127.18.70.131:55327)
0812 06:57:44.564570 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:44.564613 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:44.566274 (+ 1661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:44.566920 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:44.566930 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:44.567475 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:44.568109 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:44.568134 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.569492 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.569498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:44.571094 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:44.571107 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.571791 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.571796 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:44.571985 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:44.572533 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:44.572553 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:44.574872 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:44.577793 (+ 2921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:44.577800 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:44.577817 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:44.578276 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:44.578633 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:44.578636 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:44.578638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:44.578814 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:44.579281 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:44.579286 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:44.579598 (+ 312us) client_negotiation.cc:769] Sending connection context
0812 06:57:44.579813 (+ 215us) client_negotiation.cc:240] Negotiation successful
0812 06:57:44.580189 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":275,"threads_started":1}
I20260812 06:57:44.582777 25553 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36125
I20260812 06:57:44.583073 25553 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:44.583788 25553 heartbeater.cc:511] Master 127.18.70.190:36125 requested a full tablet report, sending...
I20260812 06:57:44.585100 24650 ts_manager.cc:194] Registered new tserver with Master: e48e1e31207a43db99716443ff2ab95e (127.18.70.131:35685)
I20260812 06:57:44.585879 24650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:55327
I20260812 06:57:44.595036 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[24564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517864, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
I20260812 06:57:44.637562 25033 heartbeater.cc:503] Master 127.18.70.190:36125 was elected leader, sending a full tablet report...
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[24564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517864, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:44.644661 25038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:44.631057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40746 (local address 127.18.70.190:36125)
0812 06:57:44.631238 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:44.631244 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:44.631675 (+ 431us) server_negotiation.cc:407] Connection header received
0812 06:57:44.631861 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:44.631865 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:44.631935 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:44.632024 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:44.633356 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.634156 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.635396 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.635810 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.635919 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:44.639867 (+ 3948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:44.639872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:44.639876 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:44.639907 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:44.642202 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.642795 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.642799 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.642801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.642937 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.643295 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.643298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.643300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.643617 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:44.643852 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:44.644151 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 06:57:44.644371 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 06:57:44.645128 24650 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:40746
I20260812 06:57:44.647085 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24776
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[24564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517864, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:57:44.661134 25569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:44.647891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34408 (local address 127.18.70.129:40633)
0812 06:57:44.648445 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:44.648461 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:44.648485 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:57:44.648536 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:44.648543 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:44.648743 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:44.648861 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:44.649951 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.650944 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.652072 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.652685 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.652791 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:44.656419 (+ 3628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:44.656431 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:44.656444 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:44.656488 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:44.658958 (+ 2470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.659558 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.659564 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.659566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.659681 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.659951 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.659953 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.659955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.660260 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:44.660503 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:44.660667 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 06:57:44.660856 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":252,"threads_started":1}
W20260812 06:57:44.662422 25026 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:34408
W20260812 06:57:44.663475 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24776: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 06:57:44.663633 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 24776
I20260812 06:57:44.688696 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25046
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[24564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517864, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 06:57:44.703402 25571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:44.689534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44250 (local address 127.18.70.130:42179)
0812 06:57:44.690128 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:44.690135 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:44.690159 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:57:44.690218 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:44.690224 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:44.690426 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:44.690559 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:44.691728 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.692718 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.693872 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.694462 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.694554 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:44.698509 (+ 3955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:44.698520 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:44.698533 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:44.698565 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:44.701016 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.701554 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.701561 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.701563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.701675 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.702039 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.702044 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.702048 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.702386 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:44.702648 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:44.702854 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 06:57:44.703106 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":293,"threads_started":1}
W20260812 06:57:44.704654 25287 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:44250
W20260812 06:57:44.705660 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25046: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 06:57:44.705812 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 25046
I20260812 06:57:44.728786 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25305
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[24564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517864, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 06:57:44.743965 25575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:44.729699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52740 (local address 127.18.70.131:35685)
0812 06:57:44.730317 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:44.730324 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:44.730354 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:57:44.730415 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:44.730422 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:44.730647 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:44.730780 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:44.732045 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.733066 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.734333 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:44.734914 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:44.735019 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:44.738954 (+ 3935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:44.738965 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:44.738980 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:44.739011 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:44.741663 (+ 2652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.742249 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.742256 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.742258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.742387 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:44.742659 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:44.742662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:44.742664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:44.742983 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:44.743206 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:44.743415 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 06:57:44.743611 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":315,"threads_started":1}
W20260812 06:57:44.745177 25544 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52740
W20260812 06:57:44.746204 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25305: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 06:57:44.746327 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 25305
I20260812 06:57:44.771811 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24586
I20260812 06:57:44.773028 24714 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:44.875524 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 24586
2026-08-12T06:57:44Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3713 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[25581](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[25581](info): set up 2 sockets
Aug 12 06:57:44 dist-test-slave-tc2s krb5kdc[25581](info): commencing operation
krb5kdc: starting...
W20260812 06:57:46.147166 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:57:46 dist-test-slave-tc2s krb5kdc[25581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:57:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:57:46.358219 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46549
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:46549
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:46.687951 25608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:46.688244 25608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:46.688380 25608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:46.695437 25608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:46.695550 25608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:46.695631 25608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:46.695711 25608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:46.695771 25608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:57:46.705346 25608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:46549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:46.706614 25608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:46.707866 25608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:46.718935 25621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:46.719020 25629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:46.719000 25625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:46.719965 25608 server_base.cc:1034] running on GCE node
I20260812 06:57:46.720708 25608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:46.722119 25608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:46.723320 25608 hybrid_clock.cc:648] HybridClock initialized: now 1786517866723273 us; error 37 us; skew 500 ppm
I20260812 06:57:46.723644 25608 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:46 dist-test-slave-tc2s krb5kdc[25581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517866, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:46.731201 25608 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:57:46.732661 25608 webserver.cc:460] Webserver started at http://127.18.70.190:42903/ using document root <none> and password file <none>
I20260812 06:57:46.733315 25608 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:46.733438 25608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:46.733734 25608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:46.736753 25608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "209669d539614a01ba7f527ddff1da15"
format_stamp: "Formatted at 2026-08-12 06:57:46 on dist-test-slave-tc2s"
server_key: "2a3ea719a2c385e47f50c520f4094147"
server_key_iv: "1bac83f4c50e3ad96bbbd548852da4bf"
server_key_version: "encryptionkey@0"
I20260812 06:57:46.737514 25608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "209669d539614a01ba7f527ddff1da15"
format_stamp: "Formatted at 2026-08-12 06:57:46 on dist-test-slave-tc2s"
server_key: "2a3ea719a2c385e47f50c520f4094147"
server_key_iv: "1bac83f4c50e3ad96bbbd548852da4bf"
server_key_version: "encryptionkey@0"
I20260812 06:57:46.742491 25608 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260812 06:57:46.745697 25644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:46.746977 25608 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:46.747143 25608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "209669d539614a01ba7f527ddff1da15"
format_stamp: "Formatted at 2026-08-12 06:57:46 on dist-test-slave-tc2s"
server_key: "2a3ea719a2c385e47f50c520f4094147"
server_key_iv: "1bac83f4c50e3ad96bbbd548852da4bf"
server_key_version: "encryptionkey@0"
I20260812 06:57:46.747331 25608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:46.768525 25608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:46.772262 25608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:46.772526 25608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:46.789492 25608 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:46549
I20260812 06:57:46.789523 25727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:46549 every 8 connection(s)
I20260812 06:57:46.790810 25608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:46.794499 25728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:46.796834 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 25608
I20260812 06:57:46.797017 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:46.797629 18714 external_mini_cluster.cc:1428] Setting key 00148d3388e9afce557aef0ade236b6d
I20260812 06:57:46.805998 25728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15: Bootstrap starting.
I20260812 06:57:46.809684 25728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:46.811008 25728 log.cc:824] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15: Log is configured to *not* fsync() on all Append() calls
Aug 12 06:57:46 dist-test-slave-tc2s krb5kdc[25581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:46.814173 25728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15: No bootstrap required, opened a new log
I20260812 06:57:46.821432 25734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:46.799606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49538 (local address 127.18.70.190:46549)
0812 06:57:46.800357 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:46.800369 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:46.800410 (+ 41us) server_negotiation.cc:407] Connection header received
0812 06:57:46.802090 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:46.802114 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:46.802501 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:46.802808 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:46.804630 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:46.805962 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:46.807679 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:46.808338 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:46.808461 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:46.813136 (+ 4675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:46.813146 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:46.813163 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:46.813208 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:46.817037 (+ 3829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:46.817676 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:46.817684 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:46.817692 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:46.817932 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:46.818265 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:46.818270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:46.818273 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:46.818952 (+ 679us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:46.819268 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:46.819578 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 06:57:46.820041 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":319,"threads_started":1}
I20260812 06:57:46.824502 25728 raft_consensus.cc:348] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209669d539614a01ba7f527ddff1da15" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46549 } }
I20260812 06:57:46.824837 25728 raft_consensus.cc:374] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:46.824913 25728 raft_consensus.cc:729] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 209669d539614a01ba7f527ddff1da15, State: Initialized, Role: FOLLOWER
I20260812 06:57:46.825424 25728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209669d539614a01ba7f527ddff1da15" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46549 } }
I20260812 06:57:46.825636 25728 raft_consensus.cc:388] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:46.825738 25728 raft_consensus.cc:482] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:46.825930 25728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:46.828167 25728 raft_consensus.cc:504] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209669d539614a01ba7f527ddff1da15" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46549 } }
I20260812 06:57:46.828763 25728 leader_election.cc:302] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 209669d539614a01ba7f527ddff1da15; no voters:
I20260812 06:57:46.829319 25728 leader_election.cc:288] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:46.829428 25739 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:46.830096 25739 raft_consensus.cc:686] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [term 1 LEADER]: Becoming Leader. State: Replica: 209669d539614a01ba7f527ddff1da15, State: Running, Role: LEADER
I20260812 06:57:46.830677 25739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209669d539614a01ba7f527ddff1da15" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46549 } }
I20260812 06:57:46.831255 25728 sys_catalog.cc:564] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:46.833237 25740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "209669d539614a01ba7f527ddff1da15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209669d539614a01ba7f527ddff1da15" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46549 } } }
I20260812 06:57:46.833606 25740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:46.833801 25748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 209669d539614a01ba7f527ddff1da15. Latest consensus state: current_term: 1 leader_uuid: "209669d539614a01ba7f527ddff1da15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "209669d539614a01ba7f527ddff1da15" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46549 } } }
I20260812 06:57:46.834139 25748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:46.839205 25755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:46.844202 25755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:46.852633 25755 catalog_manager.cc:1347] Generated new cluster ID: f08ad96785df4a72ad4ab7f8d04a1562
I20260812 06:57:46.852741 25755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:46.871652 25755 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:46.872910 25755 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:46.880599 25755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 209669d539614a01ba7f527ddff1da15: Generated new TSK 0
I20260812 06:57:46.881405 25755 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:57:46.942970 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46549
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:47.264993 25781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:47.265278 25781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:47.265422 25781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:47.272611 25781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:47.272722 25781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:47.272888 25781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:57:47.282578 25781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:47.283833 25781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:47.285116 25781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:47.297417 25793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:47.297637 25797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:47.297906 25792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:47.298238 25781 server_base.cc:1034] running on GCE node
I20260812 06:57:47.298830 25781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:47.299687 25781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:47.300889 25781 hybrid_clock.cc:648] HybridClock initialized: now 1786517867300837 us; error 44 us; skew 500 ppm
I20260812 06:57:47.301210 25781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:47 dist-test-slave-tc2s krb5kdc[25581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517867, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:47.304185 25781 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:57:47.305500 25781 webserver.cc:460] Webserver started at http://127.18.70.129:34405/ using document root <none> and password file <none>
I20260812 06:57:47.306190 25781 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:47.306298 25781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:47.306607 25781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:47.309350 25781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "2f548ac49a5241ffbde8c8d7419ed863"
format_stamp: "Formatted at 2026-08-12 06:57:47 on dist-test-slave-tc2s"
server_key: "64017712c12eb838c5c4a05581e52829"
server_key_iv: "dc47181d75fe2a8bd315c9a49844935f"
server_key_version: "encryptionkey@0"
I20260812 06:57:47.310156 25781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "2f548ac49a5241ffbde8c8d7419ed863"
format_stamp: "Formatted at 2026-08-12 06:57:47 on dist-test-slave-tc2s"
server_key: "64017712c12eb838c5c4a05581e52829"
server_key_iv: "dc47181d75fe2a8bd315c9a49844935f"
server_key_version: "encryptionkey@0"
I20260812 06:57:47.315052 25781 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 06:57:47.318274 25810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:47.319475 25781 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 06:57:47.319618 25781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "2f548ac49a5241ffbde8c8d7419ed863"
format_stamp: "Formatted at 2026-08-12 06:57:47 on dist-test-slave-tc2s"
server_key: "64017712c12eb838c5c4a05581e52829"
server_key_iv: "dc47181d75fe2a8bd315c9a49844935f"
server_key_version: "encryptionkey@0"
I20260812 06:57:47.319797 25781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:47.346930 25781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:47.350826 25781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:47.351090 25781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:47.352118 25781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:47.353415 25781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:47.353497 25781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:47.353618 25781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:47.353668 25781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:47.383615 25781 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:40267
I20260812 06:57:47.383664 26017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:40267 every 8 connection(s)
I20260812 06:57:47.384882 25781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:57:47.392918 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 25781
I20260812 06:57:47.393160 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:57:47.394042 18714 external_mini_cluster.cc:1428] Setting key 4e2b5d38eb049212efee8a7fabcf0203
Aug 12 06:57:47 dist-test-slave-tc2s krb5kdc[25581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517867, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:47.405900 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:47.387303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:44387 (local address 127.18.70.190:46549)
0812 06:57:47.387752 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:47.387758 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:47.388686 (+ 928us) server_negotiation.cc:407] Connection header received
0812 06:57:47.390508 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:47.390512 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:47.390579 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:47.390670 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:47.392035 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:47.392774 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:47.394952 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:47.395510 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:47.395632 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:47.399665 (+ 4033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:47.399670 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:47.399674 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:47.399705 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:47.402169 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:47.402972 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:47.402976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:47.402978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:47.403100 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:47.403564 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:47.403570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:47.403573 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:47.403955 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:47.404107 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:47.405051 (+ 944us) server_negotiation.cc:299] Negotiation successful
0812 06:57:47.405356 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":199,"threads_started":1}
I20260812 06:57:47.406718 26027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:47.387841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46549 (local address 127.18.70.129:44387)
0812 06:57:47.388523 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:47.388571 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:47.390276 (+ 1705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:47.390847 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:47.390855 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:47.391352 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:47.391902 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:47.391919 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:47.392935 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:47.392941 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:47.394797 (+ 1856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:47.394822 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:47.395704 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:47.395709 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:47.395969 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:47.396705 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:47.396737 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:47.399412 (+ 2675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:47.402304 (+ 2892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:47.402313 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:47.402326 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:47.402842 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:47.403194 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:47.403198 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:47.403201 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:47.403422 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:47.404104 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:47.404111 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:47.404523 (+ 412us) client_negotiation.cc:769] Sending connection context
0812 06:57:47.404814 (+ 291us) client_negotiation.cc:240] Negotiation successful
0812 06:57:47.405338 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":251,"threads_started":1}
I20260812 06:57:47.408593 26019 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46549
I20260812 06:57:47.408931 26019 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:47.409791 26019 heartbeater.cc:511] Master 127.18.70.190:46549 requested a full tablet report, sending...
I20260812 06:57:47.412550 25671 ts_manager.cc:194] Registered new tserver with Master: 2f548ac49a5241ffbde8c8d7419ed863 (127.18.70.129:40267)
I20260812 06:57:47.414609 25671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:44387
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 06:57:47.444321 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46549
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:47.768157 26032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:47.768437 26032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:47.768565 26032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:47.775959 26032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:47.776074 26032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:47.776225 26032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:57:47.786212 26032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:47.787520 26032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:47.788918 26032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:47.803506 26040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:47.803823 26041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:47.804280 26045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:47.804859 26032 server_base.cc:1034] running on GCE node
I20260812 06:57:47.805460 26032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:47.806403 26032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:47.807612 26032 hybrid_clock.cc:648] HybridClock initialized: now 1786517867807557 us; error 45 us; skew 500 ppm
I20260812 06:57:47.807909 26032 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:47 dist-test-slave-tc2s krb5kdc[25581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517867, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:47.810899 26032 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:57:47.812266 26032 webserver.cc:460] Webserver started at http://127.18.70.130:44645/ using document root <none> and password file <none>
I20260812 06:57:47.812958 26032 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:47.813072 26032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:47.813367 26032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:47.816294 26032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "2d4bea3d6449413ababae193ea2b46a1"
format_stamp: "Formatted at 2026-08-12 06:57:47 on dist-test-slave-tc2s"
server_key: "8533387da04040ccfe947c90a4773657"
server_key_iv: "2c946baee723902f648184d0b1aebb1b"
server_key_version: "encryptionkey@0"
I20260812 06:57:47.817080 26032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "2d4bea3d6449413ababae193ea2b46a1"
format_stamp: "Formatted at 2026-08-12 06:57:47 on dist-test-slave-tc2s"
server_key: "8533387da04040ccfe947c90a4773657"
server_key_iv: "2c946baee723902f648184d0b1aebb1b"
server_key_version: "encryptionkey@0"
I20260812 06:57:47.822222 26032 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260812 06:57:47.825989 26057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:47.827296 26032 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 06:57:47.827446 26032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "2d4bea3d6449413ababae193ea2b46a1"
format_stamp: "Formatted at 2026-08-12 06:57:47 on dist-test-slave-tc2s"
server_key: "8533387da04040ccfe947c90a4773657"
server_key_iv: "2c946baee723902f648184d0b1aebb1b"
server_key_version: "encryptionkey@0"
I20260812 06:57:47.827637 26032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:47.860260 26032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:47.864527 26032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:47.864811 26032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:47.865820 26032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:47.867229 26032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:47.867311 26032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:47.867441 26032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:47.867496 26032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:47.898500 26032 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:45237
I20260812 06:57:47.898550 26272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:45237 every 8 connection(s)
I20260812 06:57:47.899777 26032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:57:47.903555 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 26032
I20260812 06:57:47.903731 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:57:47.904191 18714 external_mini_cluster.cc:1428] Setting key af1912578a6a6ae6d4be56ba8e5d1c7d
Aug 12 06:57:47 dist-test-slave-tc2s krb5kdc[25581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517867, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:47.919476 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:47.902235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:33827 (local address 127.18.70.190:46549)
0812 06:57:47.902415 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:47.902419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:47.903589 (+ 1170us) server_negotiation.cc:407] Connection header received
0812 06:57:47.905631 (+ 2042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:47.905635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:47.905699 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:47.905780 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:47.907442 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:47.908140 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:47.909682 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:47.910179 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:47.910296 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:47.913829 (+ 3533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:47.913836 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:47.913842 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:47.913881 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:47.916399 (+ 2518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:47.917234 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:47.917237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:47.917239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:47.917361 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:47.917833 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:47.917836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:47.917838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:47.918127 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:47.918235 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:47.919041 (+ 806us) server_negotiation.cc:299] Negotiation successful
0812 06:57:47.919217 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 06:57:47.920962 26280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:47.902745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46549 (local address 127.18.70.130:33827)
0812 06:57:47.903437 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:47.903474 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:47.905345 (+ 1871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:47.906088 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:47.906099 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:47.906700 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:47.907269 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:47.907287 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:47.908295 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:47.908299 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:47.909525 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:47.909550 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:47.910411 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:47.910419 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:47.910641 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:47.911278 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:47.911305 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:47.913593 (+ 2288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:47.916558 (+ 2965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:47.916568 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:47.916585 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:47.917135 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:47.917469 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:47.917473 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:47.917476 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:47.917741 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:47.918248 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:47.918256 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:47.918679 (+ 423us) client_negotiation.cc:769] Sending connection context
0812 06:57:47.918980 (+ 301us) client_negotiation.cc:240] Negotiation successful
0812 06:57:47.919568 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":300,"threads_started":1}
I20260812 06:57:47.922478 26278 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46549
I20260812 06:57:47.922781 26278 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:47.923552 26278 heartbeater.cc:511] Master 127.18.70.190:46549 requested a full tablet report, sending...
I20260812 06:57:47.925053 25671 ts_manager.cc:194] Registered new tserver with Master: 2d4bea3d6449413ababae193ea2b46a1 (127.18.70.130:45237)
I20260812 06:57:47.925930 25671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:33827
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 06:57:47.953174 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46549
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:40421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:48.305392 26288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:48.305706 26288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:48.305850 26288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:48.313222 26288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:48.313342 26288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:48.313506 26288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:57:48.324052 26288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:40421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:48.325548 26288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:48.327047 26288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:48.340207 26294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:48.340247 26297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:48.340220 26295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:48.343345 26288 server_base.cc:1034] running on GCE node
I20260812 06:57:48.344008 26288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:48.344973 26288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:48.346170 26288 hybrid_clock.cc:648] HybridClock initialized: now 1786517868346115 us; error 42 us; skew 500 ppm
I20260812 06:57:48.346483 26288 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:48 dist-test-slave-tc2s krb5kdc[25581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517868, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:48.349692 26288 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:57:48.351313 26288 webserver.cc:460] Webserver started at http://127.18.70.131:44607/ using document root <none> and password file <none>
I20260812 06:57:48.352111 26288 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:48.352232 26288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:48.352547 26288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:48.355664 26288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "9e8043de4e29441abe70cf424e20dd97"
format_stamp: "Formatted at 2026-08-12 06:57:48 on dist-test-slave-tc2s"
server_key: "29ce7229ff69d1b43896e37590e3e99d"
server_key_iv: "b75ee528203741c094f57958c4ab1486"
server_key_version: "encryptionkey@0"
I20260812 06:57:48.356478 26288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "9e8043de4e29441abe70cf424e20dd97"
format_stamp: "Formatted at 2026-08-12 06:57:48 on dist-test-slave-tc2s"
server_key: "29ce7229ff69d1b43896e37590e3e99d"
server_key_iv: "b75ee528203741c094f57958c4ab1486"
server_key_version: "encryptionkey@0"
I20260812 06:57:48.361651 26288 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260812 06:57:48.365196 26309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:48.366555 26288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:48.366709 26288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "9e8043de4e29441abe70cf424e20dd97"
format_stamp: "Formatted at 2026-08-12 06:57:48 on dist-test-slave-tc2s"
server_key: "29ce7229ff69d1b43896e37590e3e99d"
server_key_iv: "b75ee528203741c094f57958c4ab1486"
server_key_version: "encryptionkey@0"
I20260812 06:57:48.366904 26288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:48.391172 26288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:48.395921 26288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:48.396220 26288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:48.397262 26288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:48.398664 26288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:48.398747 26288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:48.398870 26288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:48.398924 26288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:48.418398 26019 heartbeater.cc:503] Master 127.18.70.190:46549 was elected leader, sending a full tablet report...
I20260812 06:57:48.432626 26288 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:45575
I20260812 06:57:48.432672 26524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:45575 every 8 connection(s)
I20260812 06:57:48.434038 26288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:57:48.437426 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 26288
I20260812 06:57:48.437582 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:57:48.438129 18714 external_mini_cluster.cc:1428] Setting key 03e45803d543fb9e12bcc95fbac9c3b7
Aug 12 06:57:48 dist-test-slave-tc2s krb5kdc[25581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517868, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:48.455046 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:48.436847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:33661 (local address 127.18.70.190:46549)
0812 06:57:48.437339 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:48.437346 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:48.438555 (+ 1209us) server_negotiation.cc:407] Connection header received
0812 06:57:48.440818 (+ 2263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:48.440823 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:48.440890 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:48.440976 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:48.442794 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.443597 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.445169 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.445628 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.445736 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:48.448996 (+ 3260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:48.449001 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:48.449005 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:48.449041 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:48.451870 (+ 2829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.452618 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.452624 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.452627 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.452773 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.453275 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.453281 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.453284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.453683 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:48.453856 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:48.454592 (+ 736us) server_negotiation.cc:299] Negotiation successful
0812 06:57:48.454769 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":223,"threads_started":1}
I20260812 06:57:48.455988 26530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:48.437516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46549 (local address 127.18.70.131:33661)
0812 06:57:48.438369 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:48.438429 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:48.440483 (+ 2054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:48.441279 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:48.441288 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:48.442046 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:48.442630 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:48.442649 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.443725 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.443729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:48.445014 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:48.445025 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.445823 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.445827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:48.446081 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:48.446691 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:48.446714 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:48.448806 (+ 2092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:48.452003 (+ 3197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:48.452011 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:48.452024 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:48.452484 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:48.452900 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:48.452906 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:48.452910 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:48.453150 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:48.453845 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:48.453853 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:48.454256 (+ 403us) client_negotiation.cc:769] Sending connection context
0812 06:57:48.454487 (+ 231us) client_negotiation.cc:240] Negotiation successful
0812 06:57:48.454887 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":329,"threads_started":1}
I20260812 06:57:48.457242 26525 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46549
I20260812 06:57:48.457545 26525 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:48.458280 26525 heartbeater.cc:511] Master 127.18.70.190:46549 requested a full tablet report, sending...
I20260812 06:57:48.459630 25671 ts_manager.cc:194] Registered new tserver with Master: 9e8043de4e29441abe70cf424e20dd97 (127.18.70.131:45575)
I20260812 06:57:48.460546 25671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:33661
I20260812 06:57:48.466118 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:57:48 dist-test-slave-tc2s krb5kdc[25581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:57:48 dist-test-slave-tc2s krb5kdc[25581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:57:48.518445 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:48.503231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47014 (local address 127.18.70.129:40267)
0812 06:57:48.503871 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:48.503880 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:48.503907 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:57:48.503968 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:48.503975 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:48.504198 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:48.504350 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:48.505852 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.506986 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.508248 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.508844 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.508968 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:48.512903 (+ 3935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:48.512914 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:48.512931 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:48.512968 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:48.515638 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.516251 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.516258 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.516260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.516396 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.516788 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.516791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.516793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.517188 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:48.517482 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:48.517803 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 06:57:48.518110 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":295,"threads_started":1}
Aug 12 06:57:48 dist-test-slave-tc2s krb5kdc[25581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:48.536587 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:48.522761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49542 (local address 127.18.70.190:46549)
0812 06:57:48.523071 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:48.523077 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:48.523197 (+ 120us) server_negotiation.cc:407] Connection header received
0812 06:57:48.523338 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:48.523342 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:48.523428 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:48.523532 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:48.524917 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.525648 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.526879 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.527356 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.527483 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:48.531164 (+ 3681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:48.531171 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:48.531175 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:48.531217 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:48.533815 (+ 2598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.534487 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.534492 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.534495 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.534624 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.535011 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.535015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.535017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.535437 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:48.535675 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:48.536019 (+ 344us) server_negotiation.cc:299] Negotiation successful
0812 06:57:48.536262 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
W20260812 06:57:48.537196 25671 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49542
I20260812 06:57:48.538246 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25781
I20260812 06:57:48.550074 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:48.539136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47018 (local address 127.18.70.129:40267)
0812 06:57:48.539339 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:48.539345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:48.539545 (+ 200us) server_negotiation.cc:407] Connection header received
0812 06:57:48.539662 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:48.539665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:48.539765 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:48.539842 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:48.541016 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.541702 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.542900 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.543316 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.543409 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:48.545602 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:48.545606 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:48.545609 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:48.545636 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:48.548023 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.548582 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.548585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.548587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.548701 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.548962 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.548965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.548967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.549205 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:48.549380 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:48.549590 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 06:57:48.549760 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 06:57:48.550707 26013 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:48.634737 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 25781
I20260812 06:57:48.652184 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 26032
Aug 12 06:57:48 dist-test-slave-tc2s krb5kdc[25581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 06:57:48.668259 26545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:48.653019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39386 (local address 127.18.70.130:45237)
0812 06:57:48.653524 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:48.653531 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:48.653557 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:57:48.653622 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:48.653628 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:48.653842 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:48.654030 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:48.655257 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.656547 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.657992 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.658574 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.658670 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:48.662813 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:48.662826 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:48.662843 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:48.662878 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:48.665525 (+ 2647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.666385 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.666393 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.666395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.666537 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.666831 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.666834 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.666836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.667188 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:48.667422 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:48.667703 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 06:57:48.667921 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":234,"threads_started":1}
I20260812 06:57:48.669610 26267 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:48.752382 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 26032
I20260812 06:57:48.778085 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 26288
Aug 12 06:57:48 dist-test-slave-tc2s krb5kdc[25581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 06:57:48.794585 26549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:48.779082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34510 (local address 127.18.70.131:45575)
0812 06:57:48.779739 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:48.779747 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:48.779783 (+ 36us) server_negotiation.cc:407] Connection header received
0812 06:57:48.779845 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:48.779851 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:48.780068 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:48.780216 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:48.781522 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.782694 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.783975 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:48.784532 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:48.784645 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:48.788843 (+ 4198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:48.788855 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:48.788893 (+ 38us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:48.788928 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:48.791791 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.792493 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.792501 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.792503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.792631 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:48.792980 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:48.792985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:48.792987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:48.793346 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:48.793662 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:48.793977 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 06:57:48.794247 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":339,"threads_started":1}
I20260812 06:57:48.796020 26517 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:48.880151 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 26288
I20260812 06:57:48.901433 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25608
I20260812 06:57:48.902719 25717 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:49.007943 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 25608
2026-08-12T06:57:49Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4132 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:57:49 dist-test-slave-tc2s krb5kdc[26555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:57:49 dist-test-slave-tc2s krb5kdc[26555](info): set up 2 sockets
Aug 12 06:57:49 dist-test-slave-tc2s krb5kdc[26555](info): commencing operation
krb5kdc: starting...
W20260812 06:57:50.273794 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:57:50 dist-test-slave-tc2s krb5kdc[26555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:57:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:57:50.467379 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:42419
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:42419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:50.795027 26578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:50.795312 26578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:50.795419 26578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:50.802570 26578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:50.802677 26578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:50.802732 26578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:50.802789 26578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:50.802836 26578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:57:50.812593 26578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:42419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:42419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:50.813804 26578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:50.815129 26578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:50.826244 26593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:50.826287 26595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:50.826498 26592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:50.827085 26578 server_base.cc:1034] running on GCE node
I20260812 06:57:50.827873 26578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:50.829238 26578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:50.830451 26578 hybrid_clock.cc:648] HybridClock initialized: now 1786517870830406 us; error 32 us; skew 500 ppm
I20260812 06:57:50.830788 26578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:50 dist-test-slave-tc2s krb5kdc[26555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517870, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:50.833798 26578 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:57:50.834960 26578 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:50.835072 26578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:50.835402 26578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:50.838415 26578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "f7893d1fd2f44a3b95c08fe6de231bf4"
format_stamp: "Formatted at 2026-08-12 06:57:50 on dist-test-slave-tc2s"
server_key: "8c018aa49eecb1c489a3094679958804"
server_key_iv: "28e5525fb487102827a3c53fda76b651"
server_key_version: "encryptionkey@0"
I20260812 06:57:50.839206 26578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "f7893d1fd2f44a3b95c08fe6de231bf4"
format_stamp: "Formatted at 2026-08-12 06:57:50 on dist-test-slave-tc2s"
server_key: "8c018aa49eecb1c489a3094679958804"
server_key_iv: "28e5525fb487102827a3c53fda76b651"
server_key_version: "encryptionkey@0"
I20260812 06:57:50.844218 26578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 06:57:50.847580 26614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:50.848773 26578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:57:50.848932 26578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "f7893d1fd2f44a3b95c08fe6de231bf4"
format_stamp: "Formatted at 2026-08-12 06:57:50 on dist-test-slave-tc2s"
server_key: "8c018aa49eecb1c489a3094679958804"
server_key_iv: "28e5525fb487102827a3c53fda76b651"
server_key_version: "encryptionkey@0"
I20260812 06:57:50.849138 26578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:50.862375 26578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:50.866495 26578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:50.866739 26578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:50.883944 26578 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:42419
I20260812 06:57:50.883965 26714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:42419 every 8 connection(s)
I20260812 06:57:50.884788 26578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:50.888300 26715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:50.894976 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 26578
I20260812 06:57:50.895188 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:50.895964 18714 external_mini_cluster.cc:1428] Setting key a62ba08eb4c69beea389236c53bfa22e
I20260812 06:57:50.899075 26715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4: Bootstrap starting.
I20260812 06:57:50.902455 26715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:50.903604 26715 log.cc:824] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:50.906885 26715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4: No bootstrap required, opened a new log
Aug 12 06:57:50 dist-test-slave-tc2s krb5kdc[26555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:50.922776 26720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:50.897965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40848 (local address 127.18.70.190:42419)
0812 06:57:50.898686 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:50.898698 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:50.898742 (+ 44us) server_negotiation.cc:407] Connection header received
0812 06:57:50.900484 (+ 1742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:50.900508 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:50.900852 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:50.901150 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:50.903061 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:50.904550 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:50.906480 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:50.908685 (+ 2205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:50.911398 (+ 2713us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:50.915104 (+ 3706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:50.915115 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:50.915133 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:50.915180 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:50.918700 (+ 3520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:50.919398 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:50.919404 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:50.919410 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:50.919555 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:50.919949 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:50.919953 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:50.919955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:50.920552 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:50.920862 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:50.921346 (+ 484us) server_negotiation.cc:299] Negotiation successful
0812 06:57:50.921786 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":301,"threads_started":1}
I20260812 06:57:50.922745 26715 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7893d1fd2f44a3b95c08fe6de231bf4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42419 } }
I20260812 06:57:50.923229 26715 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:50.923338 26715 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7893d1fd2f44a3b95c08fe6de231bf4, State: Initialized, Role: FOLLOWER
I20260812 06:57:50.924017 26715 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7893d1fd2f44a3b95c08fe6de231bf4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42419 } }
I20260812 06:57:50.924336 26715 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:50.924535 26715 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:50.924777 26715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:50.928325 26715 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7893d1fd2f44a3b95c08fe6de231bf4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42419 } }
I20260812 06:57:50.928936 26715 leader_election.cc:302] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7893d1fd2f44a3b95c08fe6de231bf4; no voters:
I20260812 06:57:50.929669 26715 leader_election.cc:288] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:50.929781 26722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:50.932276 26715 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:50.936975 26722 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [term 1 LEADER]: Becoming Leader. State: Replica: f7893d1fd2f44a3b95c08fe6de231bf4, State: Running, Role: LEADER
I20260812 06:57:50.937676 26722 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7893d1fd2f44a3b95c08fe6de231bf4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42419 } }
I20260812 06:57:50.940104 26727 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7893d1fd2f44a3b95c08fe6de231bf4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7893d1fd2f44a3b95c08fe6de231bf4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42419 } } }
I20260812 06:57:50.940474 26727 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:50.940954 26724 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7893d1fd2f44a3b95c08fe6de231bf4. Latest consensus state: current_term: 1 leader_uuid: "f7893d1fd2f44a3b95c08fe6de231bf4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7893d1fd2f44a3b95c08fe6de231bf4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42419 } } }
I20260812 06:57:50.941259 26724 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:50.946422 26740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:50.955631 26740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:50.965351 26740 catalog_manager.cc:1347] Generated new cluster ID: 4e14d8027d3643c19917bd18ffa25180
I20260812 06:57:50.965453 26740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:50.976073 26754 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:57:50.979511 26740 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:50.981469 26740 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:50.994635 26740 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4: Generated new TSK 0
I20260812 06:57:50.995615 26740 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:57:51.065483 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:42419
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:51.438200 26757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:51.438472 26757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:51.438611 26757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:51.446081 26757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:51.446214 26757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:51.446379 26757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:57:51.456059 26757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:42419
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:51.457337 26757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:51.458671 26757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:51.470955 26769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:51.470912 26771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:51.471427 26774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:51.471799 26757 server_base.cc:1034] running on GCE node
I20260812 06:57:51.472358 26757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:51.473278 26757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:51.474478 26757 hybrid_clock.cc:648] HybridClock initialized: now 1786517871474407 us; error 57 us; skew 500 ppm
I20260812 06:57:51.474768 26757 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:51 dist-test-slave-tc2s krb5kdc[26555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517871, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:51.477821 26757 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:57:51.478883 26757 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:51.478997 26757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:51.479295 26757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:51.482172 26757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "cb2a814780904612846d6d0be9bd48f6"
format_stamp: "Formatted at 2026-08-12 06:57:51 on dist-test-slave-tc2s"
server_key: "644f5e4f4017379113ba8b2a6d321f04"
server_key_iv: "44801660fd7245200c183224d50aba16"
server_key_version: "encryptionkey@0"
I20260812 06:57:51.482931 26757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "cb2a814780904612846d6d0be9bd48f6"
format_stamp: "Formatted at 2026-08-12 06:57:51 on dist-test-slave-tc2s"
server_key: "644f5e4f4017379113ba8b2a6d321f04"
server_key_iv: "44801660fd7245200c183224d50aba16"
server_key_version: "encryptionkey@0"
I20260812 06:57:51.487609 26757 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 06:57:51.490793 26785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:51.491979 26757 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 06:57:51.492125 26757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "cb2a814780904612846d6d0be9bd48f6"
format_stamp: "Formatted at 2026-08-12 06:57:51 on dist-test-slave-tc2s"
server_key: "644f5e4f4017379113ba8b2a6d321f04"
server_key_iv: "44801660fd7245200c183224d50aba16"
server_key_version: "encryptionkey@0"
I20260812 06:57:51.492321 26757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:51.511714 26757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:51.515427 26757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:51.515662 26757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:51.516523 26757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:51.517774 26757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:51.517858 26757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:51.517978 26757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:51.518042 26757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:51.547883 26757 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:35265
I20260812 06:57:51.547926 27002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:35265 every 8 connection(s)
I20260812 06:57:51.548733 26757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:57:51.559163 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 26757
I20260812 06:57:51.559350 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:57:51.560194 18714 external_mini_cluster.cc:1428] Setting key 4e6574656a3d1dbb3990a1004718352e
Aug 12 06:57:51 dist-test-slave-tc2s krb5kdc[26555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517871, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:51.568131 27005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:51.551104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:34473 (local address 127.18.70.190:42419)
0812 06:57:51.551550 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:51.551555 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:51.552498 (+ 943us) server_negotiation.cc:407] Connection header received
0812 06:57:51.554402 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:51.554406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:51.554494 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:51.554587 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:51.555950 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:51.556682 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:51.558221 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:51.558616 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:51.558713 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:51.562569 (+ 3856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:51.562574 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:51.562577 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:51.562608 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:51.564945 (+ 2337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:51.565762 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:51.565767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:51.565769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:51.565939 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:51.566376 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:51.566379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:51.566381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:51.566636 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:51.566743 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:51.567524 (+ 781us) server_negotiation.cc:299] Negotiation successful
0812 06:57:51.567740 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":225,"threads_started":1}
I20260812 06:57:51.569160 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:51.551637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:42419 (local address 127.18.70.129:34473)
0812 06:57:51.552328 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:51.552365 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:51.554161 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:51.554753 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:51.554760 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:51.555257 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:51.555805 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:51.555825 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:51.556815 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:51.556821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:51.558099 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:51.558112 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:51.558784 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:51.558788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:51.558957 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:51.559622 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:51.559652 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:51.562365 (+ 2713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:51.565079 (+ 2714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:51.565087 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:51.565102 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:51.565645 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:51.566040 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:51.566045 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:51.566048 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:51.566271 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:51.566758 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:51.566765 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:51.567170 (+ 405us) client_negotiation.cc:769] Sending connection context
0812 06:57:51.567447 (+ 277us) client_negotiation.cc:240] Negotiation successful
0812 06:57:51.567917 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":273,"threads_started":1}
I20260812 06:57:51.570614 27003 heartbeater.cc:347] Connected to a master server at 127.18.70.190:42419
I20260812 06:57:51.570956 27003 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:51.571681 27003 heartbeater.cc:511] Master 127.18.70.190:42419 requested a full tablet report, sending...
I20260812 06:57:51.573763 26642 ts_manager.cc:194] Registered new tserver with Master: cb2a814780904612846d6d0be9bd48f6 (127.18.70.129:35265)
I20260812 06:57:51.575215 26642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:34473
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 06:57:51.606436 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:42419
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:51.937492 27016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:51.937777 27016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:51.937950 27016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:51.945319 27016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:51.945434 27016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:51.945611 27016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:57:51.956743 27016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:42419
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:51.958189 27016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:51.959509 27016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:51.972141 27025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:51.972182 27033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:51.972108 27029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:51.972826 27016 server_base.cc:1034] running on GCE node
I20260812 06:57:51.973480 27016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:51.974530 27016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:51.975732 27016 hybrid_clock.cc:648] HybridClock initialized: now 1786517871975689 us; error 35 us; skew 500 ppm
I20260812 06:57:51.976044 27016 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:51 dist-test-slave-tc2s krb5kdc[26555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517871, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:51.981820 27016 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:57:51.983034 27016 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:51.983148 27016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:51.983469 27016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:51.986498 27016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "6b87693d83034165949aa10a43121e77"
format_stamp: "Formatted at 2026-08-12 06:57:51 on dist-test-slave-tc2s"
server_key: "8454f832595176cba8b8f1eab2921aa4"
server_key_iv: "09ed45936c877bc9dedf477dcf227903"
server_key_version: "encryptionkey@0"
I20260812 06:57:51.987320 27016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "6b87693d83034165949aa10a43121e77"
format_stamp: "Formatted at 2026-08-12 06:57:51 on dist-test-slave-tc2s"
server_key: "8454f832595176cba8b8f1eab2921aa4"
server_key_iv: "09ed45936c877bc9dedf477dcf227903"
server_key_version: "encryptionkey@0"
I20260812 06:57:51.992592 27016 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 06:57:51.996213 27039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:51.997582 27016 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 06:57:51.997746 27016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "6b87693d83034165949aa10a43121e77"
format_stamp: "Formatted at 2026-08-12 06:57:51 on dist-test-slave-tc2s"
server_key: "8454f832595176cba8b8f1eab2921aa4"
server_key_iv: "09ed45936c877bc9dedf477dcf227903"
server_key_version: "encryptionkey@0"
I20260812 06:57:51.997998 27016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:52.012862 27016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:52.016813 27016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:52.017072 27016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:52.018106 27016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:52.019457 27016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:52.019552 27016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:52.019659 27016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:52.019734 27016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:52.053555 27016 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:38771
I20260812 06:57:52.053617 27256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:38771 every 8 connection(s)
I20260812 06:57:52.054473 27016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:57:52.055130 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 27016
I20260812 06:57:52.055303 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:57:52.055855 18714 external_mini_cluster.cc:1428] Setting key ae7ed218737b5ce18292dbc098b8308e
Aug 12 06:57:52 dist-test-slave-tc2s krb5kdc[26555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517871, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:52.075376 27005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.057065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:60569 (local address 127.18.70.190:42419)
0812 06:57:52.057259 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:52.057265 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:52.058621 (+ 1356us) server_negotiation.cc:407] Connection header received
0812 06:57:52.060467 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:52.060473 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:52.060557 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:52.060644 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:52.062249 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.062982 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.064568 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.065028 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.065142 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.069270 (+ 4128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:52.069275 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:52.069279 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:52.069316 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:52.071903 (+ 2587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:52.072882 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:52.072886 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:52.072889 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:52.073036 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:52.073587 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:52.073592 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:52.073596 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:52.073886 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:52.074055 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:52.074934 (+ 879us) server_negotiation.cc:299] Negotiation successful
0812 06:57:52.075136 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 06:57:52.076938 27262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.057634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:42419 (local address 127.18.70.130:60569)
0812 06:57:52.058467 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:52.058507 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:52.060180 (+ 1673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:52.060896 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:52.060905 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:52.061439 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:52.062062 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.062083 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.063137 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.063142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.064414 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.064428 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.065262 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.065270 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.065491 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.066219 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:52.066254 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:52.069000 (+ 2746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:52.072064 (+ 3064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:52.072073 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:52.072091 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:52.072717 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:52.073154 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:52.073159 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:52.073163 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:52.073427 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:52.074056 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:52.074064 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:52.074539 (+ 475us) client_negotiation.cc:769] Sending connection context
0812 06:57:52.074873 (+ 334us) client_negotiation.cc:240] Negotiation successful
0812 06:57:52.075474 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":363,"threads_started":1}
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
I20260812 06:57:52.078408 27260 heartbeater.cc:347] Connected to a master server at 127.18.70.190:42419
I20260812 06:57:52.078720 27260 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:52.079463 27260 heartbeater.cc:511] Master 127.18.70.190:42419 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
I20260812 06:57:52.080996 26642 ts_manager.cc:194] Registered new tserver with Master: 6b87693d83034165949aa10a43121e77 (127.18.70.130:38771)
I20260812 06:57:52.081805 26642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:60569
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 06:57:52.104714 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:42419
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:57:52.435874 27266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:52.436182 27266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:52.436324 27266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:52.443849 27266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:52.443990 27266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:52.444155 27266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:57:52.454484 27266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:42419
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:52.455859 27266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:52.457199 27266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:52.470371 27272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:52.470412 27276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:52.470446 27273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:52.471205 27266 server_base.cc:1034] running on GCE node
I20260812 06:57:52.471873 27266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:52.472842 27266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:52.474036 27266 hybrid_clock.cc:648] HybridClock initialized: now 1786517872473990 us; error 35 us; skew 500 ppm
I20260812 06:57:52.474350 27266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:57:52 dist-test-slave-tc2s krb5kdc[26555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517872, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:57:52.477375 27266 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:57:52.478605 27266 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:52.478698 27266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:52.478974 27266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:52.482020 27266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "a20ec85b3fce473984053894eb380e9d"
format_stamp: "Formatted at 2026-08-12 06:57:52 on dist-test-slave-tc2s"
server_key: "23f540175615d6c11860ac33facb9d15"
server_key_iv: "5b2e6db95c809008c06e226382a2b397"
server_key_version: "encryptionkey@0"
I20260812 06:57:52.482833 27266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "a20ec85b3fce473984053894eb380e9d"
format_stamp: "Formatted at 2026-08-12 06:57:52 on dist-test-slave-tc2s"
server_key: "23f540175615d6c11860ac33facb9d15"
server_key_iv: "5b2e6db95c809008c06e226382a2b397"
server_key_version: "encryptionkey@0"
I20260812 06:57:52.487994 27266 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 06:57:52.491559 27295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:52.492897 27266 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:57:52.493042 27266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "a20ec85b3fce473984053894eb380e9d"
format_stamp: "Formatted at 2026-08-12 06:57:52 on dist-test-slave-tc2s"
server_key: "23f540175615d6c11860ac33facb9d15"
server_key_iv: "5b2e6db95c809008c06e226382a2b397"
server_key_version: "encryptionkey@0"
I20260812 06:57:52.493252 27266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:52.509068 27266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:52.513273 27266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:52.513550 27266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:52.514619 27266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:52.515983 27266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:52.516073 27266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:52.516182 27266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:52.516254 27266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:52.547976 27266 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:45695
I20260812 06:57:52.548022 27512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:45695 every 8 connection(s)
I20260812 06:57:52.548880 27266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:57:52.555349 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 27266
I20260812 06:57:52.555557 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:57:52.556105 18714 external_mini_cluster.cc:1428] Setting key 09df6a3d7c3ffceb324a8619d0e1b73f
Aug 12 06:57:52 dist-test-slave-tc2s krb5kdc[26555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517872, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:57:52.569661 27005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.551644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:52053 (local address 127.18.70.190:42419)
0812 06:57:52.551866 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:52.551873 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:52.553055 (+ 1182us) server_negotiation.cc:407] Connection header received
0812 06:57:52.555124 (+ 2069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:52.555129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:52.555241 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:52.555326 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:52.557245 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.558201 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.560026 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.560468 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.560570 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.563965 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:52.563970 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:52.563974 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:52.564020 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:52.566637 (+ 2617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:52.567437 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:52.567443 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:52.567447 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:52.567618 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:52.568078 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:52.568082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:52.568084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:52.568373 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:52.568487 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:52.569211 (+ 724us) server_negotiation.cc:299] Negotiation successful
0812 06:57:52.569394 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 06:57:52.571102 27515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.552082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:42419 (local address 127.18.70.131:52053)
0812 06:57:52.552886 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:52.552940 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:52.554801 (+ 1861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:52.555615 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:52.555627 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:52.556431 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:52.557084 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.557105 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.558371 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.558376 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.559862 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.559877 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.560658 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.560664 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.560856 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.561470 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:57:52.561499 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:52.563749 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:52.566795 (+ 3046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:52.566804 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:52.566820 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:52.567324 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:52.567761 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:57:52.567765 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:57:52.567768 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:57:52.567977 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:57:52.568512 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:52.568519 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:52.568873 (+ 354us) client_negotiation.cc:769] Sending connection context
0812 06:57:52.569141 (+ 268us) client_negotiation.cc:240] Negotiation successful
0812 06:57:52.569658 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":304,"threads_started":1}
I20260812 06:57:52.572481 27513 heartbeater.cc:347] Connected to a master server at 127.18.70.190:42419
I20260812 06:57:52.572789 27513 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:52.573482 27513 heartbeater.cc:511] Master 127.18.70.190:42419 requested a full tablet report, sending...
I20260812 06:57:52.575085 26642 ts_manager.cc:194] Registered new tserver with Master: a20ec85b3fce473984053894eb380e9d (127.18.70.131:45695)
I20260812 06:57:52.575906 26642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:52053
I20260812 06:57:52.578516 27003 heartbeater.cc:503] Master 127.18.70.190:42419 was elected leader, sending a full tablet report...
I20260812 06:57:52.584096 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:57:52.601462 27005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.588701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40856 (local address 127.18.70.190:42419)
0812 06:57:52.588873 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:52.588880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:52.589312 (+ 432us) server_negotiation.cc:407] Connection header received
0812 06:57:52.589487 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:52.589492 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:52.589558 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:52.589641 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:52.591167 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.591904 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.593168 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.593585 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.593700 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.596001 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:52.596008 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:52.596013 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:52.596055 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:52.598892 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:52.599575 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:52.599579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:52.599581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:52.599712 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:52.600087 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:52.600091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:52.600093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:52.600442 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:52.600670 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:52.600978 (+ 308us) server_negotiation.cc:299] Negotiation successful
0812 06:57:52.601156 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 06:57:52.605546 26642 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40856:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:57:52.612442 26642 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:57:52.648792 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.625172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:45695 (local address 127.0.0.1:51138)
0812 06:57:52.639460 (+ 14288us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:52.639477 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:52.639585 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:52.641283 (+ 1698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:52.641291 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:52.641324 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:52.641736 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.641750 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.643939 (+ 2189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.643944 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.646322 (+ 2378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.646338 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.648052 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.648056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.648194 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.648230 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:57:52.648335 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 06:57:52.648481 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14148,"mutex_wait_us":71,"thread_start_us":14252,"threads_started":1}
I20260812 06:57:52.648942 27536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.625479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51138 (local address 127.18.70.131:45695)
0812 06:57:52.640358 (+ 14879us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:52.640368 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:52.640405 (+ 37us) server_negotiation.cc:407] Connection header received
0812 06:57:52.640525 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:52.640534 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:52.641052 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:52.641996 (+ 944us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:52.642266 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.643816 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.646498 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.647889 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.648026 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.648275 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:52.648407 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 06:57:52.648600 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14667,"thread_start_us":14510,"threads_started":1}
I20260812 06:57:52.649847 27537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.638785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35265 (local address 127.0.0.1:47650)
0812 06:57:52.639996 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:52.640015 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:52.640129 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:52.641869 (+ 1740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:52.641877 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:52.641943 (+ 66us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:52.642348 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.642362 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.644265 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.644270 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.646219 (+ 1949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.646232 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.649088 (+ 2856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.649094 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.649250 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.649274 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 06:57:52.649355 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 06:57:52.649485 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1069,"mutex_wait_us":99,"thread_start_us":825,"threads_started":1}
I20260812 06:57:52.649923 27538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.639047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47650 (local address 127.18.70.129:35265)
0812 06:57:52.641051 (+ 2004us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:52.641059 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:52.641086 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:57:52.641186 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:52.641194 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:52.641411 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:52.641607 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:52.642547 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.644068 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.646375 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.647886 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.648026 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.648275 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:52.649425 (+ 1150us) server_negotiation.cc:299] Negotiation successful
0812 06:57:52.649606 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1830,"thread_start_us":1654,"threads_started":1}
I20260812 06:57:52.651424 27531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.624874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:38771 (local address 127.0.0.1:48758)
0812 06:57:52.638772 (+ 13898us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:52.638832 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:52.639269 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:52.641482 (+ 2213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:52.641486 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:52.641512 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:52.641959 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.641972 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.643552 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.643557 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.646323 (+ 2766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.646338 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.650641 (+ 4303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.650648 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.650820 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.650851 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 06:57:52.650937 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:57:52.651077 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12795,"mutex_wait_us":107,"thread_start_us":12640,"threads_started":1}
I20260812 06:57:52.651539 27534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.625037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48758 (local address 127.18.70.130:38771)
0812 06:57:52.640638 (+ 15601us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:52.640646 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:52.640671 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:57:52.640756 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:52.640763 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:52.640995 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:52.641218 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:52.642163 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.643414 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.648378 (+ 4964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.650182 (+ 1804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.650316 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.650502 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:52.651047 (+ 545us) server_negotiation.cc:299] Negotiation successful
0812 06:57:52.651221 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15457,"thread_start_us":15323,"threads_started":1}
I20260812 06:57:52.653393 26880 tablet_service.cc:1467] Processing CreateTablet for tablet fb89ab12a240415a883cd2957585bdfa (DEFAULT_TABLE table=test-table [id=1723acfa6ef04985baf29209a6df5b02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:52.653398 27395 tablet_service.cc:1467] Processing CreateTablet for tablet fb89ab12a240415a883cd2957585bdfa (DEFAULT_TABLE table=test-table [id=1723acfa6ef04985baf29209a6df5b02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:52.654896 26880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb89ab12a240415a883cd2957585bdfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:52.654917 27395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb89ab12a240415a883cd2957585bdfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:52.655063 27143 tablet_service.cc:1467] Processing CreateTablet for tablet fb89ab12a240415a883cd2957585bdfa (DEFAULT_TABLE table=test-table [id=1723acfa6ef04985baf29209a6df5b02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:52.656349 27143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb89ab12a240415a883cd2957585bdfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:52.666503 27539 tablet_bootstrap.cc:492] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6: Bootstrap starting.
I20260812 06:57:52.669799 27539 tablet_bootstrap.cc:654] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:52.670738 27541 tablet_bootstrap.cc:492] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77: Bootstrap starting.
I20260812 06:57:52.671191 27539 log.cc:824] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:52.672672 27540 tablet_bootstrap.cc:492] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d: Bootstrap starting.
I20260812 06:57:52.674485 27539 tablet_bootstrap.cc:492] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6: No bootstrap required, opened a new log
I20260812 06:57:52.674598 27541 tablet_bootstrap.cc:654] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:52.674865 27539 ts_tablet_manager.cc:1397] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260812 06:57:52.675887 27541 log.cc:824] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:52.676427 27540 tablet_bootstrap.cc:654] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:52.677500 27540 log.cc:824] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:52.678819 27541 tablet_bootstrap.cc:492] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77: No bootstrap required, opened a new log
I20260812 06:57:52.679090 27541 ts_tablet_manager.cc:1397] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 06:57:52.680461 27540 tablet_bootstrap.cc:492] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d: No bootstrap required, opened a new log
I20260812 06:57:52.680742 27540 ts_tablet_manager.cc:1397] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20260812 06:57:52.682901 27539 raft_consensus.cc:348] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b87693d83034165949aa10a43121e77" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38771 } } peers { permanent_uuid: "a20ec85b3fce473984053894eb380e9d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45695 } } peers { permanent_uuid: "cb2a814780904612846d6d0be9bd48f6" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35265 } }
I20260812 06:57:52.683254 27539 raft_consensus.cc:374] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:52.683380 27539 raft_consensus.cc:729] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb2a814780904612846d6d0be9bd48f6, State: Initialized, Role: FOLLOWER
I20260812 06:57:52.683928 27539 consensus_queue.cc:260] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b87693d83034165949aa10a43121e77" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38771 } } peers { permanent_uuid: "a20ec85b3fce473984053894eb380e9d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45695 } } peers { permanent_uuid: "cb2a814780904612846d6d0be9bd48f6" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35265 } }
I20260812 06:57:52.685454 27539 ts_tablet_manager.cc:1428] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6: Time spent starting tablet: real 0.010s user 0.008s sys 0.002s
I20260812 06:57:52.690127 27541 raft_consensus.cc:348] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b87693d83034165949aa10a43121e77" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38771 } } peers { permanent_uuid: "a20ec85b3fce473984053894eb380e9d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45695 } } peers { permanent_uuid: "cb2a814780904612846d6d0be9bd48f6" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35265 } }
I20260812 06:57:52.690100 27540 raft_consensus.cc:348] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b87693d83034165949aa10a43121e77" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38771 } } peers { permanent_uuid: "a20ec85b3fce473984053894eb380e9d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45695 } } peers { permanent_uuid: "cb2a814780904612846d6d0be9bd48f6" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35265 } }
I20260812 06:57:52.690490 27541 raft_consensus.cc:374] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:52.690502 27540 raft_consensus.cc:374] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:52.690604 27541 raft_consensus.cc:729] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b87693d83034165949aa10a43121e77, State: Initialized, Role: FOLLOWER
I20260812 06:57:52.690596 27540 raft_consensus.cc:729] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a20ec85b3fce473984053894eb380e9d, State: Initialized, Role: FOLLOWER
I20260812 06:57:52.691197 27540 consensus_queue.cc:260] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b87693d83034165949aa10a43121e77" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38771 } } peers { permanent_uuid: "a20ec85b3fce473984053894eb380e9d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45695 } } peers { permanent_uuid: "cb2a814780904612846d6d0be9bd48f6" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35265 } }
I20260812 06:57:52.691192 27541 consensus_queue.cc:260] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b87693d83034165949aa10a43121e77" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38771 } } peers { permanent_uuid: "a20ec85b3fce473984053894eb380e9d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45695 } } peers { permanent_uuid: "cb2a814780904612846d6d0be9bd48f6" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35265 } }
I20260812 06:57:52.692221 27513 heartbeater.cc:503] Master 127.18.70.190:42419 was elected leader, sending a full tablet report...
I20260812 06:57:52.692220 27260 heartbeater.cc:503] Master 127.18.70.190:42419 was elected leader, sending a full tablet report...
I20260812 06:57:52.692855 27541 ts_tablet_manager.cc:1428] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77: Time spent starting tablet: real 0.014s user 0.008s sys 0.005s
I20260812 06:57:52.692883 27540 ts_tablet_manager.cc:1428] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260812 06:57:52.708225 27553 raft_consensus.cc:482] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:57:52.708527 27553 raft_consensus.cc:504] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b87693d83034165949aa10a43121e77" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38771 } } peers { permanent_uuid: "a20ec85b3fce473984053894eb380e9d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45695 } } peers { permanent_uuid: "cb2a814780904612846d6d0be9bd48f6" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35265 } }
I20260812 06:57:52.710278 27553 leader_election.cc:288] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a20ec85b3fce473984053894eb380e9d (127.18.70.131:45695), cb2a814780904612846d6d0be9bd48f6 (127.18.70.129:35265)
I20260812 06:57:52.716881 27536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.710719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:49145 (local address 127.18.70.131:45695)
0812 06:57:52.710951 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:52.710958 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:52.711698 (+ 740us) server_negotiation.cc:407] Connection header received
0812 06:57:52.711870 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:52.711873 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:52.711934 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:52.712018 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:52.712608 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.713332 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.715153 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.715913 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.716104 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.716186 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:52.716506 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 06:57:52.716630 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 06:57:52.717046 27555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.710527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:45695 (local address 127.18.70.130:49145)
0812 06:57:52.711572 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:52.711589 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:52.711716 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:52.712042 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:52.712047 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:52.712069 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:52.712453 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.712465 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.713454 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.713459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.714999 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.715011 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.716166 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.716173 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.716330 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.716376 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 06:57:52.716461 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:57:52.716594 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":886,"mutex_wait_us":39,"thread_start_us":788,"threads_started":1}
I20260812 06:57:52.717049 27538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.710899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:53763 (local address 127.18.70.129:35265)
0812 06:57:52.711117 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:52.711123 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:52.711760 (+ 637us) server_negotiation.cc:407] Connection header received
0812 06:57:52.711920 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:52.711923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:52.711989 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:52.712066 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:57:52.712716 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.713421 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.715217 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.715970 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.716252 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.716329 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:52.716668 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 06:57:52.716795 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 06:57:52.717283 27554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.710711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35265 (local address 127.18.70.130:53763)
0812 06:57:52.711580 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:52.711594 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:52.711783 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:52.712095 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:52.712099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:52.712126 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:57:52.712564 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.712574 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.713557 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.713561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.715061 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:52.715074 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.716272 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.716278 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:52.716507 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.716532 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 06:57:52.716613 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 06:57:52.716734 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":773,"mutex_wait_us":83,"spinlock_wait_cycles":22784,"thread_start_us":408,"threads_started":1}
I20260812 06:57:52.718267 27433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb89ab12a240415a883cd2957585bdfa" candidate_uuid: "6b87693d83034165949aa10a43121e77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a20ec85b3fce473984053894eb380e9d" is_pre_election: true
I20260812 06:57:52.718341 26917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb89ab12a240415a883cd2957585bdfa" candidate_uuid: "6b87693d83034165949aa10a43121e77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb2a814780904612846d6d0be9bd48f6" is_pre_election: true
I20260812 06:57:52.718888 27433 raft_consensus.cc:2454] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b87693d83034165949aa10a43121e77 in term 0.
I20260812 06:57:52.718888 26917 raft_consensus.cc:2454] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b87693d83034165949aa10a43121e77 in term 0.
I20260812 06:57:52.719866 27044 leader_election.cc:302] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b87693d83034165949aa10a43121e77, cb2a814780904612846d6d0be9bd48f6; no voters:
I20260812 06:57:52.720386 27553 raft_consensus.cc:2781] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:57:52.720587 27553 raft_consensus.cc:482] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:57:52.720695 27553 raft_consensus.cc:3037] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:52.723055 27553 raft_consensus.cc:504] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b87693d83034165949aa10a43121e77" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38771 } } peers { permanent_uuid: "a20ec85b3fce473984053894eb380e9d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45695 } } peers { permanent_uuid: "cb2a814780904612846d6d0be9bd48f6" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35265 } }
I20260812 06:57:52.723766 27553 leader_election.cc:288] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [CANDIDATE]: Term 1 election: Requested vote from peers a20ec85b3fce473984053894eb380e9d (127.18.70.131:45695), cb2a814780904612846d6d0be9bd48f6 (127.18.70.129:35265)
I20260812 06:57:52.724166 27433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb89ab12a240415a883cd2957585bdfa" candidate_uuid: "6b87693d83034165949aa10a43121e77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a20ec85b3fce473984053894eb380e9d"
I20260812 06:57:52.724280 26917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb89ab12a240415a883cd2957585bdfa" candidate_uuid: "6b87693d83034165949aa10a43121e77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb2a814780904612846d6d0be9bd48f6"
I20260812 06:57:52.724382 27433 raft_consensus.cc:3037] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:52.724478 26917 raft_consensus.cc:3037] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:52.727599 27433 raft_consensus.cc:2454] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b87693d83034165949aa10a43121e77 in term 1.
I20260812 06:57:52.727599 26917 raft_consensus.cc:2454] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b87693d83034165949aa10a43121e77 in term 1.
I20260812 06:57:52.728006 27044 leader_election.cc:302] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b87693d83034165949aa10a43121e77, cb2a814780904612846d6d0be9bd48f6; no voters:
I20260812 06:57:52.728261 27553 raft_consensus.cc:2781] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:52.728678 27553 raft_consensus.cc:686] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 1 LEADER]: Becoming Leader. State: Replica: 6b87693d83034165949aa10a43121e77, State: Running, Role: LEADER
I20260812 06:57:52.729234 27553 consensus_queue.cc:237] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b87693d83034165949aa10a43121e77" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38771 } } peers { permanent_uuid: "a20ec85b3fce473984053894eb380e9d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45695 } } peers { permanent_uuid: "cb2a814780904612846d6d0be9bd48f6" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35265 } }
I20260812 06:57:52.733695 26642 catalog_manager.cc:5495] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b87693d83034165949aa10a43121e77 (127.18.70.130). New cstate: current_term: 1 leader_uuid: "6b87693d83034165949aa10a43121e77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b87693d83034165949aa10a43121e77" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a20ec85b3fce473984053894eb380e9d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb2a814780904612846d6d0be9bd48f6" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35265 } health_report { overall_health: UNKNOWN } } }
I20260812 06:57:52.760077 27534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.754726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50282 (local address 127.18.70.130:38771)
0812 06:57:52.754950 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:52.754957 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:52.755042 (+ 85us) server_negotiation.cc:407] Connection header received
0812 06:57:52.755278 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:52.755282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:52.755365 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:52.755506 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:57:52.755891 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.756606 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.757940 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.758359 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.758469 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.758954 (+ 485us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:57:52.759483 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:57:52.759645 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:52.759722 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 06:57:52.759809 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 06:57:52.768409 27433 raft_consensus.cc:1261] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d [term 1 FOLLOWER]: Refusing update from remote peer 6b87693d83034165949aa10a43121e77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:52.768461 26917 raft_consensus.cc:1261] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6 [term 1 FOLLOWER]: Refusing update from remote peer 6b87693d83034165949aa10a43121e77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:52.769379 27557 consensus_queue.cc:1035] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a20ec85b3fce473984053894eb380e9d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:52.769712 27553 consensus_queue.cc:1035] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb2a814780904612846d6d0be9bd48f6" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:52.780846 27562 mvcc.cc:205] Tried to move back new op lower bound from 7317577206849511424 to 7317577206702931968. Current Snapshot: MvccSnapshot[applied={T|T < 7317577206849511424}]
I20260812 06:57:52.794211 26642 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:52.794512 26642 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:52.799185 26642 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7893d1fd2f44a3b95c08fe6de231bf4: Sending DeleteTablet for 3 replicas of tablet fb89ab12a240415a883cd2957585bdfa
I20260812 06:57:52.801218 26880 tablet_service.cc:1514] Processing DeleteTablet for tablet fb89ab12a240415a883cd2957585bdfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:52 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:47650
I20260812 06:57:52.801555 27395 tablet_service.cc:1514] Processing DeleteTablet for tablet fb89ab12a240415a883cd2957585bdfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:52 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:51138
I20260812 06:57:52.803020 27143 tablet_service.cc:1514] Processing DeleteTablet for tablet fb89ab12a240415a883cd2957585bdfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:52 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:48758
I20260812 06:57:52.804309 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 26757
I20260812 06:57:52.816804 27586 tablet_replica.cc:330] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d: stopping tablet replica
I20260812 06:57:52.818396 27587 tablet_replica.cc:330] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77: stopping tablet replica
I20260812 06:57:52.819270 27587 raft_consensus.cc:2229] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:57:52.819303 27585 tablet_replica.cc:330] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6: stopping tablet replica
I20260812 06:57:52.819686 27585 raft_consensus.cc:2229] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:52.819751 27587 raft_consensus.cc:2258] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:52.820152 27585 raft_consensus.cc:2258] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:52.821403 27587 ts_tablet_manager.cc:1905] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:52.828024 27587 ts_tablet_manager.cc:1918] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:57:52.828188 27587 log.cc:1196] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/fb89ab12a240415a883cd2957585bdfa
I20260812 06:57:52.828790 27587 ts_tablet_manager.cc:1939] T fb89ab12a240415a883cd2957585bdfa P 6b87693d83034165949aa10a43121e77: Deleting consensus metadata
I20260812 06:57:52.829115 27586 raft_consensus.cc:2229] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:52.830024 27585 ts_tablet_manager.cc:1905] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:52.830404 27586 raft_consensus.cc:2258] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:52.831454 26620 catalog_manager.cc:4841] TS 6b87693d83034165949aa10a43121e77 (127.18.70.130:38771): tablet fb89ab12a240415a883cd2957585bdfa (table test-table [id=1723acfa6ef04985baf29209a6df5b02]) successfully deleted
I20260812 06:57:52.832778 27586 ts_tablet_manager.cc:1905] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 06:57:52 dist-test-slave-tc2s krb5kdc[26555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:57:52.837760 27585 ts_tablet_manager.cc:1918] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:57:52.838024 27585 log.cc:1196] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/fb89ab12a240415a883cd2957585bdfa
I20260812 06:57:52.838717 27585 ts_tablet_manager.cc:1939] T fb89ab12a240415a883cd2957585bdfa P cb2a814780904612846d6d0be9bd48f6: Deleting consensus metadata
I20260812 06:57:52.839839 27586 ts_tablet_manager.cc:1918] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:57:52.840067 27586 log.cc:1196] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/fb89ab12a240415a883cd2957585bdfa
I20260812 06:57:52.840705 27586 ts_tablet_manager.cc:1939] T fb89ab12a240415a883cd2957585bdfa P a20ec85b3fce473984053894eb380e9d: Deleting consensus metadata
I20260812 06:57:52.840749 26620 catalog_manager.cc:4841] TS cb2a814780904612846d6d0be9bd48f6 (127.18.70.129:35265): tablet fb89ab12a240415a883cd2957585bdfa (table test-table [id=1723acfa6ef04985baf29209a6df5b02]) successfully deleted
I20260812 06:57:52.842442 26623 catalog_manager.cc:4841] TS a20ec85b3fce473984053894eb380e9d (127.18.70.131:45695): tablet fb89ab12a240415a883cd2957585bdfa (table test-table [id=1723acfa6ef04985baf29209a6df5b02]) successfully deleted
I20260812 06:57:52.843868 27538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.805952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47654 (local address 127.18.70.129:35265)
0812 06:57:52.806196 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:52.806203 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:52.822668 (+ 16465us) server_negotiation.cc:407] Connection header received
0812 06:57:52.822853 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:52.822859 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:52.822941 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:52.823036 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:52.824752 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.825857 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.827647 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.828306 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.828445 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.836324 (+ 7879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:52.836341 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:52.836359 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:52.836401 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:52.840518 (+ 4117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:52.841406 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:52.841416 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:52.841419 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:52.841592 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:52.842068 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:52.842073 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:52.842077 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:52.842570 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:52.842917 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:52.843141 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 06:57:52.843377 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 06:57:52.844602 26994 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:52.933863 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 26757
I20260812 06:57:52.966077 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27016
Aug 12 06:57:52 dist-test-slave-tc2s krb5kdc[26555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 06:57:52.983289 27534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:52.967146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50286 (local address 127.18.70.130:38771)
0812 06:57:52.967337 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:52.967342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:52.967421 (+ 79us) server_negotiation.cc:407] Connection header received
0812 06:57:52.967663 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:52.967668 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:52.967752 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:52.967847 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:52.969337 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.970292 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.971557 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:52.972063 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:52.972191 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:52.976407 (+ 4216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:52.976423 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:52.976442 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:52.976499 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:52.979498 (+ 2999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:52.980567 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:52.980579 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:52.980582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:52.980822 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:52.981275 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:52.981279 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:52.981281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:52.981809 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:52.982183 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:52.982679 (+ 496us) server_negotiation.cc:299] Negotiation successful
0812 06:57:52.982914 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 06:57:52.984220 27250 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:53.098856 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 27016
I20260812 06:57:53.121037 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27266
Aug 12 06:57:53 dist-test-slave-tc2s krb5kdc[26555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 06:57:53.136930 27536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:53.121857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40644 (local address 127.18.70.131:45695)
0812 06:57:53.122071 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:53.122077 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:53.122099 (+ 22us) server_negotiation.cc:407] Connection header received
0812 06:57:53.122302 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:53.122306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:53.122374 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:53.122483 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:53.123791 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:53.124554 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:53.125819 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:53.126478 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:53.126601 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:53.131037 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:53.131054 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:53.131072 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:57:53.131112 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:53.133842 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:53.134645 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:53.134653 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:53.134655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:53.134788 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:57:53.135151 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:57:53.135156 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:57:53.135159 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:57:53.135569 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:53.135848 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:53.136473 (+ 625us) server_negotiation.cc:299] Negotiation successful
0812 06:57:53.136666 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 06:57:53.138031 27507 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:53.226502 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 27266
I20260812 06:57:53.251780 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 26578
I20260812 06:57:53.252899 26707 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:53.361640 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 26578
2026-08-12T06:57:53Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4361 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T06:57:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:53Z Disabled control of system clock
I20260812 06:57:53.444569 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:34511
--webserver_interface=127.18.70.190
--webserver_port=0
--builtin_ntp_servers=127.18.70.148:37393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:34511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:57:53.779013 27610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:53.779314 27610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:53.779408 27610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:53.786747 27610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:53.786847 27610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:53.786891 27610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:53.786945 27610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:53.786989 27610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:57:53.796176 27610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:34511
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:34511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:53.797482 27610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:53.799220 27610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:53.810674 27628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:53.810734 27633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:53.810712 27631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:53.811364 27610 server_base.cc:1034] running on GCE node
I20260812 06:57:53.812127 27610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:53.813476 27610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:53.814666 27610 hybrid_clock.cc:648] HybridClock initialized: now 1786517873814611 us; error 42 us; skew 500 ppm
I20260812 06:57:53.815021 27610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:57:53.817240 27610 webserver.cc:460] Webserver started at http://127.18.70.190:34485/ using document root <none> and password file <none>
I20260812 06:57:53.817960 27610 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:53.818065 27610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:53.818383 27610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:53.821281 27610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "58e80fe188f94b268718a99dc99af1cb"
format_stamp: "Formatted at 2026-08-12 06:57:53 on dist-test-slave-tc2s"
server_key: "ec08d4a9ce9d83e846d190073395f606"
server_key_iv: "9cf6e6c587b45041712d717844e2acf0"
server_key_version: "encryptionkey@0"
I20260812 06:57:53.822121 27610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "58e80fe188f94b268718a99dc99af1cb"
format_stamp: "Formatted at 2026-08-12 06:57:53 on dist-test-slave-tc2s"
server_key: "ec08d4a9ce9d83e846d190073395f606"
server_key_iv: "9cf6e6c587b45041712d717844e2acf0"
server_key_version: "encryptionkey@0"
I20260812 06:57:53.827126 27610 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 06:57:53.830345 27644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:53.831670 27610 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 06:57:53.831823 27610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "58e80fe188f94b268718a99dc99af1cb"
format_stamp: "Formatted at 2026-08-12 06:57:53 on dist-test-slave-tc2s"
server_key: "ec08d4a9ce9d83e846d190073395f606"
server_key_iv: "9cf6e6c587b45041712d717844e2acf0"
server_key_version: "encryptionkey@0"
I20260812 06:57:53.832028 27610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:53.837769 27610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:53.838537 27610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:53.838807 27610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:53.855978 27610 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:34511
I20260812 06:57:53.856012 27736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:34511 every 8 connection(s)
I20260812 06:57:53.857432 27610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:53.861212 27737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:53.862774 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 27610
I20260812 06:57:53.863015 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:53.863857 18714 external_mini_cluster.cc:1428] Setting key c622fe83e4b7a9c26cfbba2d19bfdc2c
I20260812 06:57:53.872298 27743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:53.866089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37182 (local address 127.18.70.190:34511)
0812 06:57:53.867181 (+ 1092us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:53.867191 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:53.867231 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:57:53.868855 (+ 1624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:53.868877 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:53.869275 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:53.869608 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:53.870688 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:53.870694 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:53.870709 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:53.870730 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:53.870792 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:53.870819 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:53.871056 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:53.871197 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 06:57:53.871432 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":368,"threads_started":1}
I20260812 06:57:53.873126 27737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb: Bootstrap starting.
I20260812 06:57:53.876602 27737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:53.877609 27737 log.cc:824] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:53.880539 27737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb: No bootstrap required, opened a new log
I20260812 06:57:53.888043 27737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e80fe188f94b268718a99dc99af1cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34511 } }
I20260812 06:57:53.888433 27737 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:53.888512 27737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e80fe188f94b268718a99dc99af1cb, State: Initialized, Role: FOLLOWER
I20260812 06:57:53.889057 27737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e80fe188f94b268718a99dc99af1cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34511 } }
I20260812 06:57:53.889350 27737 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:53.889490 27737 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:53.889673 27737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:53.891948 27737 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e80fe188f94b268718a99dc99af1cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34511 } }
I20260812 06:57:53.892448 27737 leader_election.cc:302] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58e80fe188f94b268718a99dc99af1cb; no voters:
I20260812 06:57:53.893046 27737 leader_election.cc:288] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:53.893175 27747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:53.893848 27747 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [term 1 LEADER]: Becoming Leader. State: Replica: 58e80fe188f94b268718a99dc99af1cb, State: Running, Role: LEADER
I20260812 06:57:53.894405 27747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e80fe188f94b268718a99dc99af1cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34511 } }
I20260812 06:57:53.895153 27737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:53.897192 27751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58e80fe188f94b268718a99dc99af1cb. Latest consensus state: current_term: 1 leader_uuid: "58e80fe188f94b268718a99dc99af1cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e80fe188f94b268718a99dc99af1cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34511 } } }
I20260812 06:57:53.897316 27748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58e80fe188f94b268718a99dc99af1cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e80fe188f94b268718a99dc99af1cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34511 } } }
I20260812 06:57:53.897627 27751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:53.897657 27748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:53.899780 27760 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:53.904031 27760 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:53.906446 27772 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:57:53.912396 27760 catalog_manager.cc:1347] Generated new cluster ID: 804b7c7ad2274928b37a6d45749698d8
I20260812 06:57:53.912485 27760 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:53.932991 27760 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:53.933403 27760 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:53.943631 27760 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb: Generated new TSK 0
I20260812 06:57:53.944412 27760 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:57:53.959636 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34511
--builtin_ntp_servers=127.18.70.148:37393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:57:54.309762 27774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:54.310106 27774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:54.310245 27774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:54.317596 27774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:54.317684 27774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:54.317829 27774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:57:54.326895 27774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34511
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:54.328189 27774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:54.330070 27774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:54.342669 27786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:54.342762 27784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:54.342787 27782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:54.343730 27774 server_base.cc:1034] running on GCE node
I20260812 06:57:54.344334 27774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:54.345330 27774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:54.346537 27774 hybrid_clock.cc:648] HybridClock initialized: now 1786517874346480 us; error 56 us; skew 500 ppm
I20260812 06:57:54.346858 27774 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:57:54.348997 27774 webserver.cc:460] Webserver started at http://127.18.70.129:39107/ using document root <none> and password file <none>
I20260812 06:57:54.349682 27774 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:54.349781 27774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:54.350142 27774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:54.352991 27774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "ebb9515e636347e4aeaf0fa259be9c89"
format_stamp: "Formatted at 2026-08-12 06:57:54 on dist-test-slave-tc2s"
server_key: "b697137b051a286b3dd97466724f8dd7"
server_key_iv: "7d6356be60d353f74f3aafcd10b14b5c"
server_key_version: "encryptionkey@0"
I20260812 06:57:54.353814 27774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "ebb9515e636347e4aeaf0fa259be9c89"
format_stamp: "Formatted at 2026-08-12 06:57:54 on dist-test-slave-tc2s"
server_key: "b697137b051a286b3dd97466724f8dd7"
server_key_iv: "7d6356be60d353f74f3aafcd10b14b5c"
server_key_version: "encryptionkey@0"
I20260812 06:57:54.358824 27774 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 06:57:54.362234 27797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:54.363523 27774 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 06:57:54.363668 27774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "ebb9515e636347e4aeaf0fa259be9c89"
format_stamp: "Formatted at 2026-08-12 06:57:54 on dist-test-slave-tc2s"
server_key: "b697137b051a286b3dd97466724f8dd7"
server_key_iv: "7d6356be60d353f74f3aafcd10b14b5c"
server_key_version: "encryptionkey@0"
I20260812 06:57:54.363867 27774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:54.369410 27774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:54.370235 27774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:54.370487 27774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:54.371363 27774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:54.372933 27774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:54.373019 27774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:54.373100 27774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:54.373159 27774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:54.401906 27774 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:46101
I20260812 06:57:54.401963 28014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:46101 every 8 connection(s)
I20260812 06:57:54.403250 27774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:57:54.404598 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 27774
I20260812 06:57:54.404817 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:57:54.405589 18714 external_mini_cluster.cc:1428] Setting key 9cbd39512f30024117f35e4c5865a7fd
I20260812 06:57:54.408623 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34511
--builtin_ntp_servers=127.18.70.148:37393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 06:57:54.411921 28024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:54.406041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:38381 (local address 127.18.70.190:34511)
0812 06:57:54.406546 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:54.406552 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:54.407909 (+ 1357us) server_negotiation.cc:407] Connection header received
0812 06:57:54.409671 (+ 1762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:54.409677 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:54.409751 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:54.409846 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:54.411184 (+ 1338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:54.411191 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:54.411196 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:54.411215 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:54.411257 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:54.411270 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:54.411384 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:54.411567 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 06:57:54.411636 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":242,"threads_started":1}
I20260812 06:57:54.412904 28026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:54.406671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:34511 (local address 127.18.70.129:38381)
0812 06:57:54.407755 (+ 1084us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:54.407802 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:54.409413 (+ 1611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:54.410129 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:54.410143 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:54.410242 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:54.410873 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:57:54.410875 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:54.410914 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:57:54.411014 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:54.411360 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:54.411371 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:54.411378 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:57:54.411643 (+ 265us) client_negotiation.cc:240] Negotiation successful
0812 06:57:54.411889 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":494,"threads_started":1}
I20260812 06:57:54.414294 28015 heartbeater.cc:347] Connected to a master server at 127.18.70.190:34511
I20260812 06:57:54.414584 28015 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:54.415254 28015 heartbeater.cc:511] Master 127.18.70.190:34511 requested a full tablet report, sending...
I20260812 06:57:54.417718 27672 ts_manager.cc:194] Registered new tserver with Master: ebb9515e636347e4aeaf0fa259be9c89 (127.18.70.129:46101)
W20260812 06:57:54.739619 28030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:54.739878 28030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:54.739986 28030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:54.747109 28030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:54.747267 28030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:54.747403 28030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:57:54.756388 28030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34511
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:54.757683 28030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:54.759524 28030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:54.772217 28043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:54.772264 28039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:54.772296 28038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:54.773207 28030 server_base.cc:1034] running on GCE node
I20260812 06:57:54.773785 28030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:54.774701 28030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:54.775882 28030 hybrid_clock.cc:648] HybridClock initialized: now 1786517874775829 us; error 44 us; skew 500 ppm
I20260812 06:57:54.776177 28030 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:57:54.778399 28030 webserver.cc:460] Webserver started at http://127.18.70.130:42983/ using document root <none> and password file <none>
I20260812 06:57:54.779094 28030 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:54.779194 28030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:54.779546 28030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:54.782423 28030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "874683ca51af4980a9b8e871cfe5a856"
format_stamp: "Formatted at 2026-08-12 06:57:54 on dist-test-slave-tc2s"
server_key: "4477d8dfe23abaef0cffdf2be8bad764"
server_key_iv: "5547bfd1e4ce0c2be3fe776ba1c829a2"
server_key_version: "encryptionkey@0"
I20260812 06:57:54.783195 28030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "874683ca51af4980a9b8e871cfe5a856"
format_stamp: "Formatted at 2026-08-12 06:57:54 on dist-test-slave-tc2s"
server_key: "4477d8dfe23abaef0cffdf2be8bad764"
server_key_iv: "5547bfd1e4ce0c2be3fe776ba1c829a2"
server_key_version: "encryptionkey@0"
I20260812 06:57:54.788121 28030 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 06:57:54.791433 28049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:54.792645 28030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:57:54.792784 28030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "874683ca51af4980a9b8e871cfe5a856"
format_stamp: "Formatted at 2026-08-12 06:57:54 on dist-test-slave-tc2s"
server_key: "4477d8dfe23abaef0cffdf2be8bad764"
server_key_iv: "5547bfd1e4ce0c2be3fe776ba1c829a2"
server_key_version: "encryptionkey@0"
I20260812 06:57:54.792994 28030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:54.798704 28030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:54.799456 28030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:54.799701 28030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:54.800599 28030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:54.801985 28030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:54.802076 28030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:54.802156 28030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:54.802217 28030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:54.832535 28030 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:33353
I20260812 06:57:54.832580 28285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:33353 every 8 connection(s)
I20260812 06:57:54.833834 28030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:57:54.840901 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 28030
I20260812 06:57:54.841117 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:57:54.841552 18714 external_mini_cluster.cc:1428] Setting key 6e5df2f5c81090c526d5f501c290fd4e
I20260812 06:57:54.841815 28024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:54.836350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:59733 (local address 127.18.70.190:34511)
0812 06:57:54.836532 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:54.836537 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:54.837939 (+ 1402us) server_negotiation.cc:407] Connection header received
0812 06:57:54.839641 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:54.839645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:54.839702 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:54.839780 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:54.841094 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:54.841099 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:54.841102 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:54.841120 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:54.841150 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:54.841164 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:54.841284 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:54.841463 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 06:57:54.841532 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 06:57:54.842859 28288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:54.836888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:34511 (local address 127.18.70.130:59733)
0812 06:57:54.837775 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:54.837809 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:54.839395 (+ 1586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:54.839958 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:54.839965 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:54.840060 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:54.840722 (+ 662us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:57:54.840726 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:54.840776 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:57:54.840897 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:54.841259 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:54.841272 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:54.841280 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 06:57:54.841553 (+ 273us) client_negotiation.cc:240] Negotiation successful
0812 06:57:54.841799 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":271,"threads_started":1}
I20260812 06:57:54.844192 28286 heartbeater.cc:347] Connected to a master server at 127.18.70.190:34511
I20260812 06:57:54.844458 28286 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:54.844528 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34511
--builtin_ntp_servers=127.18.70.148:37393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 06:57:54.845052 28286 heartbeater.cc:511] Master 127.18.70.190:34511 requested a full tablet report, sending...
I20260812 06:57:54.846374 27672 ts_manager.cc:194] Registered new tserver with Master: 874683ca51af4980a9b8e871cfe5a856 (127.18.70.130:33353)
W20260812 06:57:55.174041 28290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:55.174307 28290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:55.174432 28290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:55.181663 28290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:55.181759 28290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:55.181933 28290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:57:55.190909 28290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34511
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:55.192209 28290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:55.194097 28290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:55.207376 28307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:55.207381 28311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:55.207420 28308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:55.208515 28290 server_base.cc:1034] running on GCE node
I20260812 06:57:55.209185 28290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:55.210127 28290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:55.211324 28290 hybrid_clock.cc:648] HybridClock initialized: now 1786517875211274 us; error 37 us; skew 500 ppm
I20260812 06:57:55.211625 28290 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:57:55.213799 28290 webserver.cc:460] Webserver started at http://127.18.70.131:39733/ using document root <none> and password file <none>
I20260812 06:57:55.214525 28290 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:55.214622 28290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:55.214977 28290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:55.218123 28290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "822f387b3fcd480ca4c63c966ae2274d"
format_stamp: "Formatted at 2026-08-12 06:57:55 on dist-test-slave-tc2s"
server_key: "01258fcbf32945060b8cbb9fa0a7b47c"
server_key_iv: "1fd494721ac513ae396abe91b2ff87a3"
server_key_version: "encryptionkey@0"
I20260812 06:57:55.218922 28290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "822f387b3fcd480ca4c63c966ae2274d"
format_stamp: "Formatted at 2026-08-12 06:57:55 on dist-test-slave-tc2s"
server_key: "01258fcbf32945060b8cbb9fa0a7b47c"
server_key_iv: "1fd494721ac513ae396abe91b2ff87a3"
server_key_version: "encryptionkey@0"
I20260812 06:57:55.223953 28290 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 06:57:55.227330 28319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:55.228550 28290 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:57:55.228693 28290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "822f387b3fcd480ca4c63c966ae2274d"
format_stamp: "Formatted at 2026-08-12 06:57:55 on dist-test-slave-tc2s"
server_key: "01258fcbf32945060b8cbb9fa0a7b47c"
server_key_iv: "1fd494721ac513ae396abe91b2ff87a3"
server_key_version: "encryptionkey@0"
I20260812 06:57:55.228888 28290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:55.234647 28290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:55.235399 28290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:55.235612 28290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:55.236487 28290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:57:55.237839 28290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:57:55.237949 28290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:55.238035 28290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:57:55.238090 28290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:55.268556 28290 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:42849
I20260812 06:57:55.268623 28557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:42849 every 8 connection(s)
I20260812 06:57:55.269958 28290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:57:55.274042 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 28290
I20260812 06:57:55.274263 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:57:55.274842 18714 external_mini_cluster.cc:1428] Setting key 2b0fa5e1d9036f2c21a691b58a8d9e56
I20260812 06:57:55.278684 28024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.272463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:43643 (local address 127.18.70.190:34511)
0812 06:57:55.272628 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:55.272632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:55.274216 (+ 1584us) server_negotiation.cc:407] Connection header received
0812 06:57:55.276254 (+ 2038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:55.276260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:55.276333 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:55.276451 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:55.277863 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:55.277870 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:55.277875 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:55.277916 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:55.277979 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:55.277994 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:55.278101 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:55.278303 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 06:57:55.278379 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 06:57:55.279604 28562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.272924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:34511 (local address 127.18.70.131:43643)
0812 06:57:55.274015 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:55.274074 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:55.275987 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:55.276710 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:55.276721 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:55.276842 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:55.277549 (+ 707us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:57:55.277552 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:55.277593 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:57:55.277680 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:55.278092 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:55.278103 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:55.278111 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 06:57:55.278396 (+ 285us) client_negotiation.cc:240] Negotiation successful
0812 06:57:55.278660 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":268,"threads_started":1}
I20260812 06:57:55.280788 28560 heartbeater.cc:347] Connected to a master server at 127.18.70.190:34511
I20260812 06:57:55.281072 28560 heartbeater.cc:464] Registering TS with master...
I20260812 06:57:55.281622 28560 heartbeater.cc:511] Master 127.18.70.190:34511 requested a full tablet report, sending...
I20260812 06:57:55.282971 27672 ts_manager.cc:194] Registered new tserver with Master: 822f387b3fcd480ca4c63c966ae2274d (127.18.70.131:42849)
I20260812 06:57:55.290205 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:57:55.296887 28024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.294502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37190 (local address 127.18.70.190:34511)
0812 06:57:55.294668 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:55.294673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:55.295220 (+ 547us) server_negotiation.cc:407] Connection header received
0812 06:57:55.295376 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:55.295381 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:55.295444 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:55.295518 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:55.296388 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:55.296394 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:55.296398 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:55.296417 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:55.296455 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:55.296471 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:55.296578 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:55.296616 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 06:57:55.296661 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 06:57:55.300757 27672 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37190:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:57:55.307562 27672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:57:55.344377 28588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.319066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:42849 (local address 127.0.0.1:60360)
0812 06:57:55.332744 (+ 13678us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:55.332801 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:55.332957 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:55.341946 (+ 8989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:55.341951 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:55.341976 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:55.342980 (+ 1004us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:57:55.342984 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:55.343016 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:57:55.343123 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:55.343545 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:55.343560 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:55.343569 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:57:55.343750 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 06:57:55.343860 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13371,"thread_start_us":22326,"threads_started":1}
I20260812 06:57:55.344434 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.334391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40832 (local address 127.18.70.129:46101)
0812 06:57:55.339818 (+ 5427us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:55.339824 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:55.341770 (+ 1946us) server_negotiation.cc:407] Connection header received
0812 06:57:55.341859 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:55.341867 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:55.342102 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:55.342262 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:55.343324 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:55.343334 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:55.343348 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:55.343368 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:55.343431 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:55.343453 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:55.343625 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:55.344016 (+ 391us) server_negotiation.cc:299] Negotiation successful
0812 06:57:55.344132 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5281,"thread_start_us":5155,"threads_started":1}
I20260812 06:57:55.344484 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.334094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46101 (local address 127.0.0.1:40832)
0812 06:57:55.341640 (+ 7546us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:55.341659 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:55.341758 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:55.342293 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:55.342297 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:55.342317 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:55.342980 (+ 663us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:57:55.342984 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:55.343017 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:57:55.343123 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:55.343545 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:55.343560 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:55.343569 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:57:55.344038 (+ 469us) client_negotiation.cc:240] Negotiation successful
0812 06:57:55.344087 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7442,"thread_start_us":5838,"threads_started":1}
I20260812 06:57:55.345124 28592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.319323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:33353 (local address 127.0.0.1:45308)
0812 06:57:55.340171 (+ 20848us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:55.340190 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:55.340317 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:55.341818 (+ 1501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:55.341826 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:55.341953 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:55.343794 (+ 1841us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:57:55.343797 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:55.343812 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:57:55.343854 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:55.344378 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:55.344392 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:55.344397 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:57:55.344573 (+ 176us) client_negotiation.cc:240] Negotiation successful
0812 06:57:55.344623 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20737,"thread_start_us":13774,"threads_started":1}
I20260812 06:57:55.345607 28589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.320040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45308 (local address 127.18.70.130:33353)
0812 06:57:55.335243 (+ 15203us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:55.335255 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:55.340323 (+ 5068us) server_negotiation.cc:407] Connection header received
0812 06:57:55.340468 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:55.340482 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:55.340784 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:55.340950 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:55.344013 (+ 3063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:55.344022 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:55.344034 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:55.344065 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:55.344125 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:55.344145 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:55.344294 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:55.345316 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0812 06:57:55.345393 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14987,"thread_start_us":15214,"threads_started":1}
I20260812 06:57:55.345813 28586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.319268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60360 (local address 127.18.70.131:42849)
0812 06:57:55.340722 (+ 21454us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:55.340731 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:55.340768 (+ 37us) server_negotiation.cc:407] Connection header received
0812 06:57:55.340844 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:55.340860 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:55.341062 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:55.342078 (+ 1016us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:55.343292 (+ 1214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:55.343301 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:55.343318 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:55.343347 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:55.343404 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:55.343420 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:55.345187 (+ 1767us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:55.345355 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 06:57:55.345451 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21252,"thread_start_us":21151,"threads_started":1}
I20260812 06:57:55.349076 28407 tablet_service.cc:1467] Processing CreateTablet for tablet 82c9bc4622c94f459d925ae0098477dc (DEFAULT_TABLE table=test-table [id=596c3dce7f7143d89acb32a9b328d0e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:55.349097 27896 tablet_service.cc:1467] Processing CreateTablet for tablet 82c9bc4622c94f459d925ae0098477dc (DEFAULT_TABLE table=test-table [id=596c3dce7f7143d89acb32a9b328d0e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:55.349354 28146 tablet_service.cc:1467] Processing CreateTablet for tablet 82c9bc4622c94f459d925ae0098477dc (DEFAULT_TABLE table=test-table [id=596c3dce7f7143d89acb32a9b328d0e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:57:55.350445 28407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c9bc4622c94f459d925ae0098477dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:55.350562 28146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c9bc4622c94f459d925ae0098477dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:55.350557 27896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c9bc4622c94f459d925ae0098477dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:55.361560 28595 tablet_bootstrap.cc:492] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: Bootstrap starting.
I20260812 06:57:55.364758 28598 tablet_bootstrap.cc:492] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89: Bootstrap starting.
I20260812 06:57:55.365289 28595 tablet_bootstrap.cc:654] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:55.366236 28599 tablet_bootstrap.cc:492] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: Bootstrap starting.
I20260812 06:57:55.366683 28595 log.cc:824] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:55.368597 28598 tablet_bootstrap.cc:654] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:55.369670 28599 tablet_bootstrap.cc:654] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:55.369968 28598 log.cc:824] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:55.370730 28599 log.cc:824] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:55.373266 28598 tablet_bootstrap.cc:492] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89: No bootstrap required, opened a new log
I20260812 06:57:55.373629 28598 ts_tablet_manager.cc:1397] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260812 06:57:55.376255 28595 tablet_bootstrap.cc:492] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: No bootstrap required, opened a new log
I20260812 06:57:55.376305 28599 tablet_bootstrap.cc:492] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: No bootstrap required, opened a new log
I20260812 06:57:55.376536 28599 ts_tablet_manager.cc:1397] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260812 06:57:55.376536 28595 ts_tablet_manager.cc:1397] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.010s
I20260812 06:57:55.381261 28598 raft_consensus.cc:348] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822f387b3fcd480ca4c63c966ae2274d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42849 } } peers { permanent_uuid: "874683ca51af4980a9b8e871cfe5a856" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 33353 } } peers { permanent_uuid: "ebb9515e636347e4aeaf0fa259be9c89" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46101 } }
I20260812 06:57:55.381611 28598 raft_consensus.cc:374] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:55.381707 28598 raft_consensus.cc:729] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebb9515e636347e4aeaf0fa259be9c89, State: Initialized, Role: FOLLOWER
I20260812 06:57:55.382295 28598 consensus_queue.cc:260] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822f387b3fcd480ca4c63c966ae2274d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42849 } } peers { permanent_uuid: "874683ca51af4980a9b8e871cfe5a856" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 33353 } } peers { permanent_uuid: "ebb9515e636347e4aeaf0fa259be9c89" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46101 } }
I20260812 06:57:55.383301 28015 heartbeater.cc:503] Master 127.18.70.190:34511 was elected leader, sending a full tablet report...
I20260812 06:57:55.383948 28598 ts_tablet_manager.cc:1428] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260812 06:57:55.386811 28595 raft_consensus.cc:348] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822f387b3fcd480ca4c63c966ae2274d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42849 } } peers { permanent_uuid: "874683ca51af4980a9b8e871cfe5a856" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 33353 } } peers { permanent_uuid: "ebb9515e636347e4aeaf0fa259be9c89" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46101 } }
I20260812 06:57:55.386811 28599 raft_consensus.cc:348] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822f387b3fcd480ca4c63c966ae2274d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42849 } } peers { permanent_uuid: "874683ca51af4980a9b8e871cfe5a856" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 33353 } } peers { permanent_uuid: "ebb9515e636347e4aeaf0fa259be9c89" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46101 } }
I20260812 06:57:55.387243 28599 raft_consensus.cc:374] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:55.387241 28595 raft_consensus.cc:374] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:55.387344 28595 raft_consensus.cc:729] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822f387b3fcd480ca4c63c966ae2274d, State: Initialized, Role: FOLLOWER
I20260812 06:57:55.387344 28599 raft_consensus.cc:729] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874683ca51af4980a9b8e871cfe5a856, State: Initialized, Role: FOLLOWER
I20260812 06:57:55.387976 28595 consensus_queue.cc:260] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822f387b3fcd480ca4c63c966ae2274d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42849 } } peers { permanent_uuid: "874683ca51af4980a9b8e871cfe5a856" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 33353 } } peers { permanent_uuid: "ebb9515e636347e4aeaf0fa259be9c89" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46101 } }
I20260812 06:57:55.387964 28599 consensus_queue.cc:260] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822f387b3fcd480ca4c63c966ae2274d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42849 } } peers { permanent_uuid: "874683ca51af4980a9b8e871cfe5a856" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 33353 } } peers { permanent_uuid: "ebb9515e636347e4aeaf0fa259be9c89" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46101 } }
I20260812 06:57:55.389199 28286 heartbeater.cc:503] Master 127.18.70.190:34511 was elected leader, sending a full tablet report...
I20260812 06:57:55.389549 28560 heartbeater.cc:503] Master 127.18.70.190:34511 was elected leader, sending a full tablet report...
I20260812 06:57:55.389694 28599 ts_tablet_manager.cc:1428] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: Time spent starting tablet: real 0.013s user 0.006s sys 0.008s
I20260812 06:57:55.390146 28595 ts_tablet_manager.cc:1428] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: Time spent starting tablet: real 0.013s user 0.013s sys 0.002s
W20260812 06:57:55.405578 28019 tablet.cc:2369] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:57:55.521592 28561 tablet.cc:2369] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:57:55.536931 28608 raft_consensus.cc:482] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:57:55.537277 28608 raft_consensus.cc:504] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822f387b3fcd480ca4c63c966ae2274d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42849 } } peers { permanent_uuid: "874683ca51af4980a9b8e871cfe5a856" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 33353 } } peers { permanent_uuid: "ebb9515e636347e4aeaf0fa259be9c89" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46101 } }
I20260812 06:57:55.539168 28608 leader_election.cc:288] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 822f387b3fcd480ca4c63c966ae2274d (127.18.70.131:42849), 874683ca51af4980a9b8e871cfe5a856 (127.18.70.130:33353)
I20260812 06:57:55.542632 28589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.539716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:47899 (local address 127.18.70.130:33353)
0812 06:57:55.539930 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:55.539937 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:55.540736 (+ 799us) server_negotiation.cc:407] Connection header received
0812 06:57:55.540859 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:55.540863 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:55.540920 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:55.541015 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:55.541974 (+ 959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:55.541979 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:55.541984 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:55.542005 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:55.542045 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:55.542060 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:55.542152 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:55.542268 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 06:57:55.542349 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 06:57:55.542711 28586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.539820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:50427 (local address 127.18.70.131:42849)
0812 06:57:55.540020 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:55.540027 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:55.540630 (+ 603us) server_negotiation.cc:407] Connection header received
0812 06:57:55.540772 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:55.540777 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:55.540842 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:55.540921 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:55.542069 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:55.542073 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:55.542077 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:55.542091 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:55.542128 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:55.542142 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:55.542269 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:55.542376 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 06:57:55.542432 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 06:57:55.542884 28613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.539813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:33353 (local address 127.18.70.129:47899)
0812 06:57:55.540618 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:55.540637 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:55.540750 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:55.541054 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:55.541058 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:55.541079 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:55.541762 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:57:55.541765 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:55.541778 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:57:55.541820 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:55.542145 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:55.542150 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:55.542155 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:57:55.542295 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 06:57:55.542348 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":479,"threads_started":1}
I20260812 06:57:55.542984 28612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.539745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:42849 (local address 127.18.70.129:50427)
0812 06:57:55.540524 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:55.540540 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:55.540652 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:55.540967 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:55.540972 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:55.540996 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:57:55.541853 (+ 857us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:57:55.541855 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:57:55.541869 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:57:55.541937 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:57:55.542257 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:57:55.542261 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:57:55.542270 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:57:55.542412 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 06:57:55.542460 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"thread_start_us":420,"threads_started":1}
I20260812 06:57:55.543891 28188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c9bc4622c94f459d925ae0098477dc" candidate_uuid: "ebb9515e636347e4aeaf0fa259be9c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874683ca51af4980a9b8e871cfe5a856" is_pre_election: true
I20260812 06:57:55.544001 28457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c9bc4622c94f459d925ae0098477dc" candidate_uuid: "ebb9515e636347e4aeaf0fa259be9c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822f387b3fcd480ca4c63c966ae2274d" is_pre_election: true
I20260812 06:57:55.544374 28188 raft_consensus.cc:2454] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebb9515e636347e4aeaf0fa259be9c89 in term 0.
I20260812 06:57:55.544427 28457 raft_consensus.cc:2454] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebb9515e636347e4aeaf0fa259be9c89 in term 0.
I20260812 06:57:55.545007 27808 leader_election.cc:302] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 822f387b3fcd480ca4c63c966ae2274d, 874683ca51af4980a9b8e871cfe5a856, ebb9515e636347e4aeaf0fa259be9c89; no voters:
I20260812 06:57:55.545363 28608 raft_consensus.cc:2781] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:57:55.545490 28608 raft_consensus.cc:482] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:57:55.545600 28608 raft_consensus.cc:3037] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:55.547827 28608 raft_consensus.cc:504] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822f387b3fcd480ca4c63c966ae2274d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42849 } } peers { permanent_uuid: "874683ca51af4980a9b8e871cfe5a856" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 33353 } } peers { permanent_uuid: "ebb9515e636347e4aeaf0fa259be9c89" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46101 } }
I20260812 06:57:55.548374 28608 leader_election.cc:288] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [CANDIDATE]: Term 1 election: Requested vote from peers 822f387b3fcd480ca4c63c966ae2274d (127.18.70.131:42849), 874683ca51af4980a9b8e871cfe5a856 (127.18.70.130:33353)
I20260812 06:57:55.548874 28457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c9bc4622c94f459d925ae0098477dc" candidate_uuid: "ebb9515e636347e4aeaf0fa259be9c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822f387b3fcd480ca4c63c966ae2274d"
I20260812 06:57:55.548853 28188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c9bc4622c94f459d925ae0098477dc" candidate_uuid: "ebb9515e636347e4aeaf0fa259be9c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874683ca51af4980a9b8e871cfe5a856"
I20260812 06:57:55.549058 28457 raft_consensus.cc:3037] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:55.549065 28188 raft_consensus.cc:3037] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:55.552296 28457 raft_consensus.cc:2454] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebb9515e636347e4aeaf0fa259be9c89 in term 1.
I20260812 06:57:55.552320 28188 raft_consensus.cc:2454] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebb9515e636347e4aeaf0fa259be9c89 in term 1.
I20260812 06:57:55.552768 27808 leader_election.cc:302] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 874683ca51af4980a9b8e871cfe5a856, ebb9515e636347e4aeaf0fa259be9c89; no voters:
I20260812 06:57:55.553123 28608 raft_consensus.cc:2781] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:55.553612 28608 raft_consensus.cc:686] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 1 LEADER]: Becoming Leader. State: Replica: ebb9515e636347e4aeaf0fa259be9c89, State: Running, Role: LEADER
I20260812 06:57:55.554477 28608 consensus_queue.cc:237] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822f387b3fcd480ca4c63c966ae2274d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42849 } } peers { permanent_uuid: "874683ca51af4980a9b8e871cfe5a856" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 33353 } } peers { permanent_uuid: "ebb9515e636347e4aeaf0fa259be9c89" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46101 } }
I20260812 06:57:55.561702 27672 catalog_manager.cc:5495] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebb9515e636347e4aeaf0fa259be9c89 (127.18.70.129). New cstate: current_term: 1 leader_uuid: "ebb9515e636347e4aeaf0fa259be9c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822f387b3fcd480ca4c63c966ae2274d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874683ca51af4980a9b8e871cfe5a856" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 33353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebb9515e636347e4aeaf0fa259be9c89" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46101 } health_report { overall_health: HEALTHY } } }
W20260812 06:57:55.585819 28287 tablet.cc:2369] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:57:55.618901 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.617000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40836 (local address 127.18.70.129:46101)
0812 06:57:55.617162 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:55.617167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:55.617260 (+ 93us) server_negotiation.cc:407] Connection header received
0812 06:57:55.617443 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:55.617446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:55.617537 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:55.617620 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:55.618436 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:55.618440 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:55.618443 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:55.618458 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:55.618488 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:55.618507 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:55.618593 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:55.618649 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 06:57:55.618694 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 06:57:55.626892 28188 raft_consensus.cc:1261] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856 [term 1 FOLLOWER]: Refusing update from remote peer ebb9515e636347e4aeaf0fa259be9c89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:55.626889 28457 raft_consensus.cc:1261] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d [term 1 FOLLOWER]: Refusing update from remote peer ebb9515e636347e4aeaf0fa259be9c89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:57:55.627912 28617 consensus_queue.cc:1035] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822f387b3fcd480ca4c63c966ae2274d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:55.628237 28608 consensus_queue.cc:1035] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874683ca51af4980a9b8e871cfe5a856" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:57:55.665884 27672 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:55.666244 27672 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:57:55.670001 27672 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 58e80fe188f94b268718a99dc99af1cb: Sending DeleteTablet for 3 replicas of tablet 82c9bc4622c94f459d925ae0098477dc
I20260812 06:57:55.671133 28407 tablet_service.cc:1514] Processing DeleteTablet for tablet 82c9bc4622c94f459d925ae0098477dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:55 UTC) from {username='slave'} at 127.0.0.1:60360
I20260812 06:57:55.671326 28146 tablet_service.cc:1514] Processing DeleteTablet for tablet 82c9bc4622c94f459d925ae0098477dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:55 UTC) from {username='slave'} at 127.0.0.1:45308
I20260812 06:57:55.671540 27896 tablet_service.cc:1514] Processing DeleteTablet for tablet 82c9bc4622c94f459d925ae0098477dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:57:55 UTC) from {username='slave'} at 127.0.0.1:40832
I20260812 06:57:55.672515 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27774
I20260812 06:57:55.684631 28645 tablet_replica.cc:330] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: stopping tablet replica
I20260812 06:57:55.685177 28645 raft_consensus.cc:2229] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:55.685719 28645 raft_consensus.cc:2258] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:55.687569 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.673841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40846 (local address 127.18.70.129:46101)
0812 06:57:55.674061 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:55.674068 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:55.682091 (+ 8023us) server_negotiation.cc:407] Connection header received
0812 06:57:55.683105 (+ 1014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:55.683112 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:55.683185 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:55.683265 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:55.686637 (+ 3372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:55.686644 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:55.686649 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:55.686672 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:55.686714 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:55.686736 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:55.686841 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:55.687122 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 06:57:55.687196 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 06:57:55.688746 28004 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:55.688979 28650 tablet_replica.cc:330] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: stopping tablet replica
I20260812 06:57:55.689431 28650 raft_consensus.cc:2229] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:57:55.689810 28651 tablet_replica.cc:330] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89: stopping tablet replica
I20260812 06:57:55.690030 28650 raft_consensus.cc:2258] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:57:55.691074 28645 ts_tablet_manager.cc:1905] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:55.691924 28650 ts_tablet_manager.cc:1905] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:57:55.697706 28650 ts_tablet_manager.cc:1918] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:57:55.697846 28650 log.cc:1196] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/82c9bc4622c94f459d925ae0098477dc
I20260812 06:57:55.698370 28650 ts_tablet_manager.cc:1939] T 82c9bc4622c94f459d925ae0098477dc P 874683ca51af4980a9b8e871cfe5a856: Deleting consensus metadata
I20260812 06:57:55.698622 28645 ts_tablet_manager.cc:1918] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:57:55.698791 28645 log.cc:1196] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/82c9bc4622c94f459d925ae0098477dc
I20260812 06:57:55.699285 28645 ts_tablet_manager.cc:1939] T 82c9bc4622c94f459d925ae0098477dc P 822f387b3fcd480ca4c63c966ae2274d: Deleting consensus metadata
I20260812 06:57:55.700073 27651 catalog_manager.cc:4841] TS 874683ca51af4980a9b8e871cfe5a856 (127.18.70.130:33353): tablet 82c9bc4622c94f459d925ae0098477dc (table test-table [id=596c3dce7f7143d89acb32a9b328d0e8]) successfully deleted
I20260812 06:57:55.700882 27646 catalog_manager.cc:4841] TS 822f387b3fcd480ca4c63c966ae2274d (127.18.70.131:42849): tablet 82c9bc4622c94f459d925ae0098477dc (table test-table [id=596c3dce7f7143d89acb32a9b328d0e8]) successfully deleted
I20260812 06:57:55.690340 28651 raft_consensus.cc:2229] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:57:55.786779 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 27774
I20260812 06:57:55.786778 28651 raft_consensus.cc:2258] T 82c9bc4622c94f459d925ae0098477dc P ebb9515e636347e4aeaf0fa259be9c89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 06:57:55.810556 27651 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.70.129:46101 (error 108)
I20260812 06:57:55.810791 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 28030
I20260812 06:57:55.812337 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.811911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46101 (local address 127.0.0.1:40850)
0812 06:57:55.812083 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:55.812198 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:46101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 06:57:55.812582 27651 catalog_manager.cc:4584] TS ebb9515e636347e4aeaf0fa259be9c89 (127.18.70.129:46101): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 82c9bc4622c94f459d925ae0098477dc: Network error: Client connection negotiation failed: client connection to 127.18.70.129:46101: connect: Connection refused (error 111)
I20260812 06:57:55.813570 28589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.811523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45310 (local address 127.18.70.130:33353)
0812 06:57:55.811688 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:55.811692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:55.811710 (+ 18us) server_negotiation.cc:407] Connection header received
0812 06:57:55.811877 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:55.811883 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:55.811993 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:55.812081 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:55.812955 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:55.812961 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:55.812965 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:55.812980 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:55.813015 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:55.813029 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:55.813145 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:55.813243 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 06:57:55.813304 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 06:57:55.814153 28270 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:55.866334 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.865752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46101 (local address 127.0.0.1:40862)
0812 06:57:55.866015 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:55.866130 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:46101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 06:57:55.867468 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.867081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46101 (local address 127.0.0.1:40866)
0812 06:57:55.867236 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:55.867332 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:46101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 06:57:55.901670 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 28030
I20260812 06:57:55.924813 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 28290
I20260812 06:57:55.927423 28586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.925587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60372 (local address 127.18.70.131:42849)
0812 06:57:55.925762 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:55.925767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:55.925786 (+ 19us) server_negotiation.cc:407] Connection header received
0812 06:57:55.925940 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:55.925947 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:55.926054 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:55.926138 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:55.926880 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:55.926885 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:55.926888 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:55.926904 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:55.926939 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:55.926951 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:55.927061 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:55.927099 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 06:57:55.927148 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 06:57:55.928063 28550 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:55.928707 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.928143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46101 (local address 127.0.0.1:40870)
0812 06:57:55.928345 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:55.928504 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:46101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 06:57:55.929774 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:55.929393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46101 (local address 127.0.0.1:40874)
0812 06:57:55.929548 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:55.929633 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:46101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 06:57:56.010636 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:56.010060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46101 (local address 127.0.0.1:40884)
0812 06:57:56.010349 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:56.010449 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:46101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260812 06:57:56.011699 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:56.011305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46101 (local address 127.0.0.1:40896)
0812 06:57:56.011513 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:56.011584 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:46101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260812 06:57:56.017612 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 28290
I20260812 06:57:56.045660 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27610
I20260812 06:57:56.046813 27732 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:56.154120 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 27610
2026-08-12T06:57:56Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2784 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 06:57:56.201601 18714 mini_oidc.cc:152] Starting JWKS server
I20260812 06:57:56.204633 18714 webserver.cc:460] Webserver started at https://127.0.0.1:39697/ using document root <none> and password file <none>
I20260812 06:57:56.204949 18714 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:57:56.205624 18714 webserver.cc:460] Webserver started at http://127.0.0.1:41923/ using document root <none> and password file <none>
2026-08-12T06:57:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:56Z Disabled control of system clock
I20260812 06:57:56.234390 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41177
--webserver_interface=127.18.70.190
--webserver_port=0
--builtin_ntp_servers=127.18.70.148:37727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:41177
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39697/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/testchainca.cert with env {}
W20260812 06:57:56.561357 28677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:56.561628 28677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:56.561726 28677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:56.568841 28677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:56.568948 28677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:56.568997 28677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:56.569058 28677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:56.569104 28677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:57:56.569164 28677 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:57:56.569202 28677 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39697/jwks.json
I20260812 06:57:56.578922 28677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:41177
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39697/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:56.580132 28677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:56.581426 28677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:56.592763 28688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:56.592701 28691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:56.592701 28697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:56.593456 28677 server_base.cc:1034] running on GCE node
I20260812 06:57:56.594283 28677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:56.595587 28677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:56.596783 28677 hybrid_clock.cc:648] HybridClock initialized: now 1786517876596743 us; error 30 us; skew 500 ppm
I20260812 06:57:56.597124 28677 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:57:56.599350 28677 webserver.cc:460] Webserver started at http://127.18.70.190:41411/ using document root <none> and password file <none>
I20260812 06:57:56.600049 28677 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:56.600150 28677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:56.600461 28677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:56.603353 28677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "872df785bdd340deb1d9c6b77ff825ae"
format_stamp: "Formatted at 2026-08-12 06:57:56 on dist-test-slave-tc2s"
server_key: "d41a29b8dcfba35926dc59f44ee177c6"
server_key_iv: "80373113c72f6b30444c8cc3f9f1878c"
server_key_version: "encryptionkey@0"
I20260812 06:57:56.604120 28677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "872df785bdd340deb1d9c6b77ff825ae"
format_stamp: "Formatted at 2026-08-12 06:57:56 on dist-test-slave-tc2s"
server_key: "d41a29b8dcfba35926dc59f44ee177c6"
server_key_iv: "80373113c72f6b30444c8cc3f9f1878c"
server_key_version: "encryptionkey@0"
I20260812 06:57:56.609023 28677 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260812 06:57:56.612416 28713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:56.613693 28677 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 06:57:56.613865 28677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "872df785bdd340deb1d9c6b77ff825ae"
format_stamp: "Formatted at 2026-08-12 06:57:56 on dist-test-slave-tc2s"
server_key: "d41a29b8dcfba35926dc59f44ee177c6"
server_key_iv: "80373113c72f6b30444c8cc3f9f1878c"
server_key_version: "encryptionkey@0"
I20260812 06:57:56.614121 28677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:56.636384 28677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:56.637179 28677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:56.637480 28677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:56.654554 28677 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:41177
I20260812 06:57:56.654561 28803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:41177 every 8 connection(s)
I20260812 06:57:56.655913 28677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:56.659672 28804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:56.662422 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 28677
I20260812 06:57:56.662622 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:56.663487 18714 external_mini_cluster.cc:1428] Setting key fe300392f6d189730cf673de64cb5dec
I20260812 06:57:56.671780 28804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae: Bootstrap starting.
I20260812 06:57:56.675325 28804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:56.676469 28804 log.cc:824] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:56.676995 28809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:56.665430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56762 (local address 127.18.70.190:41177)
0812 06:57:56.666391 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:56.666402 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:56.666442 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:57:56.668106 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:56.668132 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:56.668588 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:56.668902 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:56.669516 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:56.670824 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:56.672635 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:56.673308 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:56.673443 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:56.674677 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:56.674684 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:56.674697 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:56.675192 (+ 495us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:56.675284 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:56.675308 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:56.675394 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:56.675641 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 06:57:56.675944 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":387,"threads_started":1}
I20260812 06:57:56.679364 28804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae: No bootstrap required, opened a new log
I20260812 06:57:56.680546 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:57:56.686721 28804 raft_consensus.cc:348] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872df785bdd340deb1d9c6b77ff825ae" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41177 } }
I20260812 06:57:56.687038 28804 raft_consensus.cc:374] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:56.687130 28804 raft_consensus.cc:729] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 872df785bdd340deb1d9c6b77ff825ae, State: Initialized, Role: FOLLOWER
I20260812 06:57:56.687650 28804 consensus_queue.cc:260] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872df785bdd340deb1d9c6b77ff825ae" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41177 } }
I20260812 06:57:56.687857 28804 raft_consensus.cc:388] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:56.687979 28804 raft_consensus.cc:482] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:56.688128 28804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:56.690205 28804 raft_consensus.cc:504] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872df785bdd340deb1d9c6b77ff825ae" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41177 } }
I20260812 06:57:56.690689 28804 leader_election.cc:302] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 872df785bdd340deb1d9c6b77ff825ae; no voters:
I20260812 06:57:56.691205 28804 leader_election.cc:288] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:56.691342 28814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:56.692003 28814 raft_consensus.cc:686] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [term 1 LEADER]: Becoming Leader. State: Replica: 872df785bdd340deb1d9c6b77ff825ae, State: Running, Role: LEADER
I20260812 06:57:56.692544 28814 consensus_queue.cc:237] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872df785bdd340deb1d9c6b77ff825ae" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41177 } }
I20260812 06:57:56.693166 28804 sys_catalog.cc:564] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:56.695477 28822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "872df785bdd340deb1d9c6b77ff825ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872df785bdd340deb1d9c6b77ff825ae" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41177 } } }
I20260812 06:57:56.695878 28822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:56.695751 28823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 872df785bdd340deb1d9c6b77ff825ae. Latest consensus state: current_term: 1 leader_uuid: "872df785bdd340deb1d9c6b77ff825ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "872df785bdd340deb1d9c6b77ff825ae" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41177 } } }
I20260812 06:57:56.696085 28823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:56.698081 28835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:56.703351 28835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:56.712172 28835 catalog_manager.cc:1347] Generated new cluster ID: f05e1ed8b3ca4d6889c35343d10357f5
I20260812 06:57:56.712277 28835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:56.742954 28835 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:56.744242 28835 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:56.750730 28835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 872df785bdd340deb1d9c6b77ff825ae: Generated new TSK 0
I20260812 06:57:56.751543 28835 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 06:57:56.793708 28869 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 06:57:56.793985 28869 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 06:57:56.795010 28809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:56.773137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56768 (local address 127.18.70.190:41177)
0812 06:57:56.773370 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:56.773376 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:56.773793 (+ 417us) server_negotiation.cc:407] Connection header received
0812 06:57:56.774231 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:56.774235 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:56.774306 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:56.774430 (+ 124us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:57:56.775062 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:56.775792 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:56.777923 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:56.778373 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:56.778471 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:56.779100 (+ 629us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:57:56.794449 (+ 15349us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39697/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 06:57:56.794761 (+ 312us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56768: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39697/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":87}
W20260812 06:57:56.795131 28809 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56768: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39697/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 06:57:56.797246 28868 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:57:56.772984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41177 (local address 127.0.0.1:56768)
0812 06:57:56.773679 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:56.773700 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:56.773918 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:56.774474 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:56.774479 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:56.774493 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:57:56.774911 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:56.774924 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:56.775926 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:56.775931 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:56.777755 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:56.777772 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:56.778551 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:56.778558 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:56.778750 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:56.778831 (+ 81us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:57:56.794763 (+ 15932us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39697/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 06:57:56.795158 (+ 395us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.70.190:41177: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39697/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":329,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.18.70.190:41177: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39697/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 06:57:56.799361 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 28677
I20260812 06:57:56.800485 28799 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:56.896239 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 28677
2026-08-12T06:57:56Z chronyd exiting
I20260812 06:57:56.955587 18714 test_util.cc:175] -----------------------------------------------
I20260812 06:57:56.955703 18714 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786517832212618-18714-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (758 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 06:57:56.959478 18714 mini_oidc.cc:152] Starting JWKS server
I20260812 06:57:56.961201 18714 webserver.cc:460] Webserver started at https://127.0.0.1:34273/ using document root <none> and password file <none>
I20260812 06:57:56.961404 18714 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:57:56.962002 18714 webserver.cc:460] Webserver started at http://127.0.0.1:42323/ using document root <none> and password file <none>
2026-08-12T06:57:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:56Z Disabled control of system clock
I20260812 06:57:56.989750 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:35427
--webserver_interface=127.18.70.190
--webserver_port=0
--builtin_ntp_servers=127.18.70.148:35553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:35427
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34273/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/testchainca.cert with env {}
W20260812 06:57:57.310886 28882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:57.311194 28882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:57.311285 28882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:57.318687 28882 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:57.318795 28882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:57.318840 28882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:57.318890 28882 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:57.318938 28882 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:57:57.319001 28882 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:57:57.319041 28882 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34273/jwks.json
I20260812 06:57:57.329448 28882 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:35553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:35427
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:35427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34273/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:57.330793 28882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:57.332064 28882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:57.344022 28889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:57.344033 28895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:57.344563 28891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:57.344679 28882 server_base.cc:1034] running on GCE node
I20260812 06:57:57.345432 28882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:57.346956 28882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:57.348157 28882 hybrid_clock.cc:648] HybridClock initialized: now 1786517877348100 us; error 41 us; skew 500 ppm
I20260812 06:57:57.348572 28882 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:57:57.355836 28882 webserver.cc:460] Webserver started at http://127.18.70.190:42735/ using document root <none> and password file <none>
I20260812 06:57:57.356567 28882 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:57.356665 28882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:57.356998 28882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:57.359956 28882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "d6b484c517d948508a58dba785d0ab94"
format_stamp: "Formatted at 2026-08-12 06:57:57 on dist-test-slave-tc2s"
server_key: "fd3ff6ad8f5c316073bf1e61517c168e"
server_key_iv: "4df140e6061fb08d99000587c218d4ab"
server_key_version: "encryptionkey@0"
I20260812 06:57:57.360774 28882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "d6b484c517d948508a58dba785d0ab94"
format_stamp: "Formatted at 2026-08-12 06:57:57 on dist-test-slave-tc2s"
server_key: "fd3ff6ad8f5c316073bf1e61517c168e"
server_key_iv: "4df140e6061fb08d99000587c218d4ab"
server_key_version: "encryptionkey@0"
I20260812 06:57:57.365981 28882 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 06:57:57.369274 28905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:57.370647 28882 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 06:57:57.370816 28882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "d6b484c517d948508a58dba785d0ab94"
format_stamp: "Formatted at 2026-08-12 06:57:57 on dist-test-slave-tc2s"
server_key: "fd3ff6ad8f5c316073bf1e61517c168e"
server_key_iv: "4df140e6061fb08d99000587c218d4ab"
server_key_version: "encryptionkey@0"
I20260812 06:57:57.371032 28882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:57.401646 28882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:57.402562 28882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:57.402859 28882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:57.424094 28882 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:35427
I20260812 06:57:57.424114 29004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:35427 every 8 connection(s)
I20260812 06:57:57.425432 28882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:57.429558 29005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:57.435912 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 28882
I20260812 06:57:57.436137 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:57.437024 18714 external_mini_cluster.cc:1428] Setting key d715dc87a5761b4a5995344b7b563ca4
I20260812 06:57:57.440724 29005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94: Bootstrap starting.
I20260812 06:57:57.444013 29005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:57.445225 29005 log.cc:824] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:57.448472 29005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94: No bootstrap required, opened a new log
I20260812 06:57:57.450700 29010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:57.438972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45438 (local address 127.18.70.190:35427)
0812 06:57:57.439916 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:57.439926 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:57.439967 (+ 41us) server_negotiation.cc:407] Connection header received
0812 06:57:57.441624 (+ 1657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:57.441648 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:57.442129 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:57.442449 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:57.443030 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:57.444365 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:57.446250 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:57.447052 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:57.447190 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:57.448368 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:57.448376 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:57.448389 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:57.448970 (+ 581us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:57.449047 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:57.449069 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:57.449155 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:57.449425 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 06:57:57.449716 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":336,"threads_started":1}
I20260812 06:57:57.454674 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:57:57.458010 29005 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b484c517d948508a58dba785d0ab94" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35427 } }
I20260812 06:57:57.458410 29005 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:57.458542 29005 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6b484c517d948508a58dba785d0ab94, State: Initialized, Role: FOLLOWER
I20260812 06:57:57.459247 29005 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b484c517d948508a58dba785d0ab94" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35427 } }
I20260812 06:57:57.459513 29005 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:57.459645 29005 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:57.459806 29005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:57.462153 29005 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b484c517d948508a58dba785d0ab94" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35427 } }
I20260812 06:57:57.462776 29005 leader_election.cc:302] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6b484c517d948508a58dba785d0ab94; no voters:
I20260812 06:57:57.463349 29005 leader_election.cc:288] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:57.463481 29015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:57.464138 29015 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [term 1 LEADER]: Becoming Leader. State: Replica: d6b484c517d948508a58dba785d0ab94, State: Running, Role: LEADER
I20260812 06:57:57.464702 29015 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b484c517d948508a58dba785d0ab94" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35427 } }
I20260812 06:57:57.465446 29005 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:57.467469 29018 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6b484c517d948508a58dba785d0ab94. Latest consensus state: current_term: 1 leader_uuid: "d6b484c517d948508a58dba785d0ab94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b484c517d948508a58dba785d0ab94" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35427 } } }
I20260812 06:57:57.468001 29018 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:57.467582 29016 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6b484c517d948508a58dba785d0ab94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b484c517d948508a58dba785d0ab94" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35427 } } }
I20260812 06:57:57.468467 29016 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:57.471760 29026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:57.477418 29026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:57.489449 29026 catalog_manager.cc:1347] Generated new cluster ID: 64894bcd58ad4ec9a66ac1c22fed3d46
I20260812 06:57:57.489591 29026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:57.503232 29026 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:57.505183 29026 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:57.523106 29026 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6b484c517d948508a58dba785d0ab94: Generated new TSK 0
I20260812 06:57:57.524340 29026 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 06:57:57.567637 29060 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 06:57:57.567795 29060 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 06:57:57.568985 29010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:57.541058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45450 (local address 127.18.70.190:35427)
0812 06:57:57.541275 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:57.541282 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:57.541748 (+ 466us) server_negotiation.cc:407] Connection header received
0812 06:57:57.542055 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:57.542060 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:57.542147 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:57.542290 (+ 143us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:57:57.542798 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:57.543577 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:57.544993 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:57.545479 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:57.545601 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:57.546194 (+ 593us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:57:57.568223 (+ 22029us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34273/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 06:57:57.568633 (+ 410us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45450: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34273/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 06:57:57.569151 29010 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45450: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34273/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 06:57:57.569305 29058 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:57:57.540988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:35427 (local address 127.0.0.1:45450)
0812 06:57:57.541629 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:57.541649 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:57.541812 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:57.542330 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:57.542334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:57.542346 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:57:57.542618 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:57.542629 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:57.543730 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:57.543734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:57.544843 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:57.544856 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:57.545656 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:57.545663 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:57.545835 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:57.545877 (+ 42us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:57:57.568524 (+ 22647us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34273/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 06:57:57.568862 (+ 338us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.70.190:35427: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34273/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":381,"threads_started":1}
I20260812 06:57:57.571044 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 28882
I20260812 06:57:57.572911 28999 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:57.680449 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 28882
2026-08-12T06:57:57Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (800 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 06:57:57.761406 18714 mini_oidc.cc:152] Starting JWKS server
I20260812 06:57:57.763494 18714 webserver.cc:460] Webserver started at https://127.0.0.1:45883/ using document root <none> and password file <none>
I20260812 06:57:57.763703 18714 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:57:57.764559 18714 webserver.cc:460] Webserver started at http://127.0.0.1:42587/ using document root <none> and password file <none>
2026-08-12T06:57:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:57Z Disabled control of system clock
I20260812 06:57:57.803172 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43677
--webserver_interface=127.18.70.190
--webserver_port=0
--builtin_ntp_servers=127.18.70.148:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:43677
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45883/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 06:57:58.185160 29077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:58.185532 29077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:58.185676 29077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:58.193153 29077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:58.193277 29077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:58.193344 29077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:58.193430 29077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:58.193504 29077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:57:58.193601 29077 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:57:58.193652 29077 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45883/jwks.json
I20260812 06:57:58.204311 29077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:43677
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45883/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:58.205801 29077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:58.207789 29077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:58.220367 29085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:58.220257 29086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:58.220279 29089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:58.221364 29077 server_base.cc:1034] running on GCE node
I20260812 06:57:58.222800 29077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:58.224624 29077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:58.225874 29077 hybrid_clock.cc:648] HybridClock initialized: now 1786517878225813 us; error 48 us; skew 500 ppm
I20260812 06:57:58.226332 29077 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:57:58.228916 29077 webserver.cc:460] Webserver started at http://127.18.70.190:43267/ using document root <none> and password file <none>
I20260812 06:57:58.229676 29077 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:58.229786 29077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:58.230196 29077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:58.233317 29077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "3b51c250677f42f3898021adbb9a86f5"
format_stamp: "Formatted at 2026-08-12 06:57:58 on dist-test-slave-tc2s"
server_key: "74e197e76cc9eb6b84e508c9484ff65b"
server_key_iv: "aa2d37f2d820943e0c33eb9c492dd64d"
server_key_version: "encryptionkey@0"
I20260812 06:57:58.234242 29077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "3b51c250677f42f3898021adbb9a86f5"
format_stamp: "Formatted at 2026-08-12 06:57:58 on dist-test-slave-tc2s"
server_key: "74e197e76cc9eb6b84e508c9484ff65b"
server_key_iv: "aa2d37f2d820943e0c33eb9c492dd64d"
server_key_version: "encryptionkey@0"
I20260812 06:57:58.240574 29077 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260812 06:57:58.245517 29100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:58.247198 29077 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 06:57:58.247414 29077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "3b51c250677f42f3898021adbb9a86f5"
format_stamp: "Formatted at 2026-08-12 06:57:58 on dist-test-slave-tc2s"
server_key: "74e197e76cc9eb6b84e508c9484ff65b"
server_key_iv: "aa2d37f2d820943e0c33eb9c492dd64d"
server_key_version: "encryptionkey@0"
I20260812 06:57:58.247682 29077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:58.264394 29077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:58.265540 29077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:58.265990 29077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:58.295837 29077 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:43677
I20260812 06:57:58.295871 29207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:43677 every 8 connection(s)
I20260812 06:57:58.297803 29077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:58.303767 29208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:58.306919 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 29077
I20260812 06:57:58.307152 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:58.308064 18714 external_mini_cluster.cc:1428] Setting key 5ecbbdcd46e3c141aecf22e36265dc71
I20260812 06:57:58.321470 29208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5: Bootstrap starting.
I20260812 06:57:58.326028 29211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:58.310824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53294 (local address 127.18.70.190:43677)
0812 06:57:58.312156 (+ 1332us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:58.312177 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:58.312236 (+ 59us) server_negotiation.cc:407] Connection header received
0812 06:57:58.314736 (+ 2500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:58.314774 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:58.315422 (+ 648us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:58.315888 (+ 466us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:58.316491 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:58.318558 (+ 2067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:58.320221 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:58.321190 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:58.321414 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:58.322793 (+ 1379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:58.322802 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:58.322822 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:58.323506 (+ 684us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:58.323612 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:58.323642 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:58.323770 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:58.324004 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 06:57:58.324400 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":422,"threads_started":1}
I20260812 06:57:58.326501 29208 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:58.328213 29208 log.cc:824] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:58.331475 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:57:58.332423 29208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5: No bootstrap required, opened a new log
I20260812 06:57:58.342087 29208 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b51c250677f42f3898021adbb9a86f5" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43677 } }
I20260812 06:57:58.342521 29208 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:58.342624 29208 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b51c250677f42f3898021adbb9a86f5, State: Initialized, Role: FOLLOWER
I20260812 06:57:58.343242 29208 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b51c250677f42f3898021adbb9a86f5" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43677 } }
I20260812 06:57:58.343490 29208 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:58.343626 29208 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:58.343793 29208 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:58.346493 29208 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b51c250677f42f3898021adbb9a86f5" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43677 } }
I20260812 06:57:58.347064 29208 leader_election.cc:302] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b51c250677f42f3898021adbb9a86f5; no voters:
I20260812 06:57:58.347796 29208 leader_election.cc:288] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:58.348061 29214 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:58.349061 29214 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [term 1 LEADER]: Becoming Leader. State: Replica: 3b51c250677f42f3898021adbb9a86f5, State: Running, Role: LEADER
I20260812 06:57:58.349758 29214 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b51c250677f42f3898021adbb9a86f5" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43677 } }
I20260812 06:57:58.350203 29208 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:58.353783 29218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b51c250677f42f3898021adbb9a86f5. Latest consensus state: current_term: 1 leader_uuid: "3b51c250677f42f3898021adbb9a86f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b51c250677f42f3898021adbb9a86f5" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43677 } } }
I20260812 06:57:58.354322 29218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:58.353658 29216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b51c250677f42f3898021adbb9a86f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b51c250677f42f3898021adbb9a86f5" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43677 } } }
I20260812 06:57:58.354741 29216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:58.357575 29233 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:58.363471 29233 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:58.372896 29233 catalog_manager.cc:1347] Generated new cluster ID: 9d37e5ef1bfd4530be1945eaf49bfa87
I20260812 06:57:58.373090 29233 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:58.418503 29233 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:58.420179 29233 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:58.430428 29233 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b51c250677f42f3898021adbb9a86f5: Generated new TSK 0
I20260812 06:57:58.431419 29233 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:57:58.466943 29211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:58.457030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53310 (local address 127.18.70.190:43677)
0812 06:57:58.457334 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:58.457343 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:58.457803 (+ 460us) server_negotiation.cc:407] Connection header received
0812 06:57:58.458269 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:58.458278 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:58.458390 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:58.458566 (+ 176us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:57:58.459186 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:58.460084 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:58.462295 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:58.462842 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:58.462953 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:58.463749 (+ 796us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:57:58.466234 (+ 2485us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45883/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 06:57:58.466612 (+ 378us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53310: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45883/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":95}
W20260812 06:57:58.467077 29211 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53310: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45883/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 06:57:58.469179 29259 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:57:58.456883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43677 (local address 127.0.0.1:53310)
0812 06:57:58.457645 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:58.457669 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:58.457882 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:58.458622 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:58.458628 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:58.458643 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:57:58.459015 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:58.459028 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:58.460248 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:58.460254 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:58.462112 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:58.462129 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:58.463062 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:58.463069 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:58.463267 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:58.463320 (+ 53us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:57:58.466478 (+ 3158us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45883/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 06:57:58.468634 (+ 2156us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.70.190:43677: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45883/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":593,"mutex_wait_us":1797,"thread_start_us":386,"threads_started":1}
I20260812 06:57:58.471050 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 29077
I20260812 06:57:58.472469 29197 generic_service.cc:196] Checking for leaks (request via RPC)
E20260812 06:57:58.479288 29262 webserver.cc:533] Webserver: sslize failed:
E20260812 06:57:58.479449 29262 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 06:57:58.572587 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 29077
2026-08-12T06:57:58Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (881 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T06:57:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:57:58Z Disabled control of system clock
I20260812 06:57:58.683135 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:44993
--webserver_interface=127.18.70.190
--webserver_port=0
--builtin_ntp_servers=127.18.70.148:40911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:44993
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/testchainca.cert with env {}
W20260812 06:57:59.046563 29269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:57:59.046872 29269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:57:59.046962 29269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:57:59.054288 29269 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:57:59.054406 29269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:57:59.054450 29269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:57:59.054498 29269 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:57:59.054548 29269 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:57:59.054612 29269 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:57:59.054672 29269 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 06:57:59.065529 29269 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:40911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:44993
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:44993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:57:59.066885 29269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:57:59.068218 29269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:57:59.081123 29276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:59.081180 29277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:57:59.081097 29282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:57:59.082731 29269 server_base.cc:1034] running on GCE node
I20260812 06:57:59.083746 29269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:57:59.085487 29269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:57:59.086782 29269 hybrid_clock.cc:648] HybridClock initialized: now 1786517879086714 us; error 41 us; skew 500 ppm
I20260812 06:57:59.087309 29269 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:57:59.090615 29269 webserver.cc:460] Webserver started at http://127.18.70.190:45339/ using document root <none> and password file <none>
I20260812 06:57:59.091447 29269 fs_manager.cc:359] Metadata directory not provided
I20260812 06:57:59.091555 29269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:57:59.091884 29269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:57:59.095090 29269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "ad117946142d44718cdcdc55026702b1"
format_stamp: "Formatted at 2026-08-12 06:57:59 on dist-test-slave-tc2s"
server_key: "2b729bb425f15793b88540bf2ec2ef46"
server_key_iv: "8a63228b1cda975ca1eab92f15ae823f"
server_key_version: "encryptionkey@0"
I20260812 06:57:59.095947 29269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "ad117946142d44718cdcdc55026702b1"
format_stamp: "Formatted at 2026-08-12 06:57:59 on dist-test-slave-tc2s"
server_key: "2b729bb425f15793b88540bf2ec2ef46"
server_key_iv: "8a63228b1cda975ca1eab92f15ae823f"
server_key_version: "encryptionkey@0"
I20260812 06:57:59.101652 29269 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 06:57:59.105571 29303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:57:59.107376 29269 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:57:59.107591 29269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "ad117946142d44718cdcdc55026702b1"
format_stamp: "Formatted at 2026-08-12 06:57:59 on dist-test-slave-tc2s"
server_key: "2b729bb425f15793b88540bf2ec2ef46"
server_key_iv: "8a63228b1cda975ca1eab92f15ae823f"
server_key_version: "encryptionkey@0"
I20260812 06:57:59.107861 29269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:57:59.121102 29269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:57:59.122653 29269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:57:59.123011 29269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:57:59.144430 29269 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:44993
I20260812 06:57:59.144476 29413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:44993 every 8 connection(s)
I20260812 06:57:59.146193 29269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:57:59.147609 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 29269
I20260812 06:57:59.147863 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:57:59.148689 18714 external_mini_cluster.cc:1428] Setting key 0158b19e0fdb7db992af6a9504e8c56c
I20260812 06:57:59.151837 29416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:57:59.166394 29423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:59.151166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43700 (local address 127.18.70.190:44993)
0812 06:57:59.152405 (+ 1239us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:59.152420 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:59.152485 (+ 65us) server_negotiation.cc:407] Connection header received
0812 06:57:59.154523 (+ 2038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:59.154554 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:59.155235 (+ 681us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:59.155737 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:57:59.156586 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:59.158227 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:59.160374 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:59.161125 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:59.161275 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:59.163384 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:57:59.163395 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:57:59.163416 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:57:59.164167 (+ 751us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:57:59.164275 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:57:59.164309 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:57:59.164452 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 06:57:59.164727 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 06:57:59.165147 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":396,"threads_started":1}
I20260812 06:57:59.167320 29416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1: Bootstrap starting.
I20260812 06:57:59.170607 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:57:59.170938 29416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1: Neither blocks nor log segments found. Creating new log.
I20260812 06:57:59.171928 29416 log.cc:824] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:57:59.175132 29416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1: No bootstrap required, opened a new log
I20260812 06:57:59.183486 29416 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad117946142d44718cdcdc55026702b1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44993 } }
I20260812 06:57:59.183981 29416 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:57:59.184087 29416 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad117946142d44718cdcdc55026702b1, State: Initialized, Role: FOLLOWER
I20260812 06:57:59.184784 29416 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad117946142d44718cdcdc55026702b1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44993 } }
I20260812 06:57:59.185046 29416 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:57:59.185197 29416 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:57:59.185374 29416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:57:59.188194 29416 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad117946142d44718cdcdc55026702b1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44993 } }
I20260812 06:57:59.188889 29416 leader_election.cc:302] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad117946142d44718cdcdc55026702b1; no voters:
I20260812 06:57:59.189615 29416 leader_election.cc:288] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:57:59.189772 29427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:57:59.190845 29427 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [term 1 LEADER]: Becoming Leader. State: Replica: ad117946142d44718cdcdc55026702b1, State: Running, Role: LEADER
I20260812 06:57:59.191437 29427 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad117946142d44718cdcdc55026702b1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44993 } }
I20260812 06:57:59.191952 29416 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:57:59.194809 29428 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad117946142d44718cdcdc55026702b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad117946142d44718cdcdc55026702b1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44993 } } }
I20260812 06:57:59.195538 29428 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:59.194772 29431 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad117946142d44718cdcdc55026702b1. Latest consensus state: current_term: 1 leader_uuid: "ad117946142d44718cdcdc55026702b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad117946142d44718cdcdc55026702b1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44993 } } }
I20260812 06:57:59.196388 29431 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:57:59.199122 29448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:57:59.204914 29448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:57:59.215428 29448 catalog_manager.cc:1347] Generated new cluster ID: abca756d05174391816ca8751f7d47ac
I20260812 06:57:59.215700 29448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:57:59.247248 29448 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:57:59.249311 29448 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:57:59.259248 29448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad117946142d44718cdcdc55026702b1: Generated new TSK 0
I20260812 06:57:59.260434 29448 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:57:59.769848 29423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:57:59.281709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43706 (local address 127.18.70.190:44993)
0812 06:57:59.281973 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 06:57:59.281983 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:57:59.282564 (+ 581us) server_negotiation.cc:407] Connection header received
0812 06:57:59.282850 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:57:59.282856 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:57:59.282942 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:57:59.283087 (+ 145us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:57:59.283701 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:59.284709 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:59.286964 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:57:59.287448 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:57:59.287579 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:59.288144 (+ 565us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:57:59.769246 (+481102us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 06:57:59.769615 (+ 369us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43706: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 06:57:59.770012 29423 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43706: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 06:57:59.770309 29475 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:57:59.281665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44993 (local address 127.0.0.1:43706)
0812 06:57:59.282397 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0812 06:57:59.282418 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:57:59.282588 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:57:59.283124 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:57:59.283128 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:57:59.283142 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:57:59.283485 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:59.283500 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:59.284915 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:59.284921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:59.286793 (+ 1872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:57:59.286810 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:57:59.287641 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:57:59.287648 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:57:59.287828 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:57:59.287880 (+ 52us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:57:59.769588 (+481708us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 06:57:59.769857 (+ 269us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.70.190:44993: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":382,"threads_started":1}
I20260812 06:57:59.771708 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 29269
I20260812 06:57:59.772848 29407 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:57:59.882818 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 29269
2026-08-12T06:57:59Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1288 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (1465 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (412 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:58:01 dist-test-slave-tc2s krb5kdc[29513](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:58:01 dist-test-slave-tc2s krb5kdc[29513](info): set up 2 sockets
Aug 12 06:58:01 dist-test-slave-tc2s krb5kdc[29513](info): commencing operation
krb5kdc: starting...
W20260812 06:58:03.018191 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:58:03 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:58:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:58:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:58:03.237720 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43641
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:36241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:43641
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:03.574831 29543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:03.575145 29543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:03.575278 29543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:03.582839 29543 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:58:03.582964 29543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:03.583041 29543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:03.583118 29543 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:58:03.583182 29543 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:58:03.593557 29543 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:36241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:43641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:03.594970 29543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:03.596292 29543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:03.607671 29553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:03.607745 29558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:03.607697 29555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:03.608749 29543 server_base.cc:1034] running on GCE node
I20260812 06:58:03.609544 29543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:03.610950 29543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:03.612188 29543 hybrid_clock.cc:648] HybridClock initialized: now 1786517883612130 us; error 34 us; skew 500 ppm
I20260812 06:58:03.612555 29543 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:03 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517883, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:03.618559 29543 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:58:03.620152 29543 webserver.cc:460] Webserver started at http://127.18.70.190:36369/ using document root <none> and password file <none>
I20260812 06:58:03.620872 29543 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:03.620978 29543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:03.621258 29543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:03.624424 29543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "df454f6fb339402da91e5230c2a5abb1"
format_stamp: "Formatted at 2026-08-12 06:58:03 on dist-test-slave-tc2s"
server_key: "3e1a3359d8950a0a9b3215a6e39e3aa3"
server_key_iv: "fedfe44b5f018d0c17a28bfecd1d5251"
server_key_version: "encryptionkey@0"
I20260812 06:58:03.625296 29543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "df454f6fb339402da91e5230c2a5abb1"
format_stamp: "Formatted at 2026-08-12 06:58:03 on dist-test-slave-tc2s"
server_key: "3e1a3359d8950a0a9b3215a6e39e3aa3"
server_key_iv: "fedfe44b5f018d0c17a28bfecd1d5251"
server_key_version: "encryptionkey@0"
I20260812 06:58:03.630878 29543 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 06:58:03.634372 29574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:03.635725 29543 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 06:58:03.635895 29543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "df454f6fb339402da91e5230c2a5abb1"
format_stamp: "Formatted at 2026-08-12 06:58:03 on dist-test-slave-tc2s"
server_key: "3e1a3359d8950a0a9b3215a6e39e3aa3"
server_key_iv: "fedfe44b5f018d0c17a28bfecd1d5251"
server_key_version: "encryptionkey@0"
I20260812 06:58:03.636102 29543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:03.651449 29543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:03.655897 29543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:03.656194 29543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:03.674369 29543 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:43641
I20260812 06:58:03.674433 29687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:43641 every 8 connection(s)
I20260812 06:58:03.675786 29543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:58:03.679670 29689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:03.679800 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 29543
I20260812 06:58:03.680052 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:58:03.680902 18714 external_mini_cluster.cc:1428] Setting key 14301973f2bf2020b1183f8cc9b41089
I20260812 06:58:03.693595 29689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1: Bootstrap starting.
Aug 12 06:58:03 dist-test-slave-tc2s krb5kdc[29513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:03.697576 29689 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:03.698697 29689 log.cc:824] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:03.702189 29689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1: No bootstrap required, opened a new log
I20260812 06:58:03.705129 29694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:03.683014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34846 (local address 127.18.70.190:43641)
0812 06:58:03.683775 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:03.683790 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:03.683832 (+ 42us) server_negotiation.cc:407] Connection header received
0812 06:58:03.685887 (+ 2055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:03.685943 (+ 56us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:03.686350 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:03.686662 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:03.688362 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:03.689677 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:03.691556 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:03.692300 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:03.692449 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:03.697320 (+ 4871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:03.697329 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:03.697345 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:03.697389 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:03.700762 (+ 3373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:03.701630 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:03.701637 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:03.701644 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:03.701824 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:03.702361 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:03.702365 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:03.702367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:03.702944 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:03.703187 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:03.703679 (+ 492us) server_negotiation.cc:299] Negotiation successful
0812 06:58:03.704054 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":335,"threads_started":1}
I20260812 06:58:03.710309 29689 raft_consensus.cc:348] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df454f6fb339402da91e5230c2a5abb1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43641 } }
I20260812 06:58:03.710759 29689 raft_consensus.cc:374] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:03.710887 29689 raft_consensus.cc:729] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df454f6fb339402da91e5230c2a5abb1, State: Initialized, Role: FOLLOWER
I20260812 06:58:03.711560 29689 consensus_queue.cc:260] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df454f6fb339402da91e5230c2a5abb1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43641 } }
I20260812 06:58:03.711778 29689 raft_consensus.cc:388] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:58:03.711872 29689 raft_consensus.cc:482] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:58:03.711993 29689 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:03.714183 29689 raft_consensus.cc:504] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df454f6fb339402da91e5230c2a5abb1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43641 } }
I20260812 06:58:03.714608 29689 leader_election.cc:302] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df454f6fb339402da91e5230c2a5abb1; no voters:
I20260812 06:58:03.715293 29689 leader_election.cc:288] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:58:03.715381 29699 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:03.716070 29699 raft_consensus.cc:686] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [term 1 LEADER]: Becoming Leader. State: Replica: df454f6fb339402da91e5230c2a5abb1, State: Running, Role: LEADER
I20260812 06:58:03.716564 29699 consensus_queue.cc:237] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df454f6fb339402da91e5230c2a5abb1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43641 } }
I20260812 06:58:03.717285 29689 sys_catalog.cc:564] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:58:03.719374 29700 sys_catalog.cc:455] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df454f6fb339402da91e5230c2a5abb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df454f6fb339402da91e5230c2a5abb1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43641 } } }
I20260812 06:58:03.719858 29701 sys_catalog.cc:455] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df454f6fb339402da91e5230c2a5abb1. Latest consensus state: current_term: 1 leader_uuid: "df454f6fb339402da91e5230c2a5abb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df454f6fb339402da91e5230c2a5abb1" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43641 } } }
I20260812 06:58:03.720054 29700 sys_catalog.cc:458] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:03.720121 29701 sys_catalog.cc:458] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:03.722483 29713 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:58:03.728312 29713 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:58:03.744391 29713 catalog_manager.cc:1347] Generated new cluster ID: 4694b3357e9c471f8eab77ace572e06e
I20260812 06:58:03.744524 29713 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:58:03.781327 29713 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:58:03.783241 29713 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:58:03.797655 29713 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df454f6fb339402da91e5230c2a5abb1: Generated new TSK 0
I20260812 06:58:03.798977 29713 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:58:03.865200 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43641
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:36241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:04.204188 29738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:04.204509 29738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:04.204664 29738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:04.212265 29738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:04.212410 29738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:04.212577 29738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:58:04.223146 29738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:36241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:04.224591 29738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:04.225970 29738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:04.239557 29749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:04.239637 29754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:04.239580 29759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:04.240278 29738 server_base.cc:1034] running on GCE node
I20260812 06:58:04.241017 29738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:04.242096 29738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:04.243294 29738 hybrid_clock.cc:648] HybridClock initialized: now 1786517884243250 us; error 36 us; skew 500 ppm
I20260812 06:58:04.243618 29738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:04 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517884, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:04.246929 29738 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:58:04.248481 29738 webserver.cc:460] Webserver started at http://127.18.70.129:36361/ using document root <none> and password file <none>
I20260812 06:58:04.249212 29738 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:04.249317 29738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:04.249641 29738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:04.252771 29738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "3a9da76ce51f47d3acc6a0ea0f2343a3"
format_stamp: "Formatted at 2026-08-12 06:58:04 on dist-test-slave-tc2s"
server_key: "9031c334a67611d72c56ca0aaa51b245"
server_key_iv: "4131c495c7d3d467b22c482e011b362d"
server_key_version: "encryptionkey@0"
I20260812 06:58:04.253585 29738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "3a9da76ce51f47d3acc6a0ea0f2343a3"
format_stamp: "Formatted at 2026-08-12 06:58:04 on dist-test-slave-tc2s"
server_key: "9031c334a67611d72c56ca0aaa51b245"
server_key_iv: "4131c495c7d3d467b22c482e011b362d"
server_key_version: "encryptionkey@0"
I20260812 06:58:04.258989 29738 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 06:58:04.262452 29773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:04.263733 29738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 06:58:04.263890 29738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "3a9da76ce51f47d3acc6a0ea0f2343a3"
format_stamp: "Formatted at 2026-08-12 06:58:04 on dist-test-slave-tc2s"
server_key: "9031c334a67611d72c56ca0aaa51b245"
server_key_iv: "4131c495c7d3d467b22c482e011b362d"
server_key_version: "encryptionkey@0"
I20260812 06:58:04.264086 29738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:04.315724 29738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:04.320036 29738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:04.320328 29738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:04.321360 29738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:04.322860 29738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:04.322942 29738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:04.323066 29738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:04.323120 29738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:04.354233 29738 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:43601
I20260812 06:58:04.354292 30011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:43601 every 8 connection(s)
I20260812 06:58:04.355634 29738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:58:04.358733 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 29738
I20260812 06:58:04.358980 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:58:04.359854 18714 external_mini_cluster.cc:1428] Setting key ba1be91e8c5c3bfd067ce020807b986f
Aug 12 06:58:04 dist-test-slave-tc2s krb5kdc[29513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517884, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:04.377200 30017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:04.358415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:53803 (local address 127.18.70.190:43641)
0812 06:58:04.358902 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:04.358909 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:04.360119 (+ 1210us) server_negotiation.cc:407] Connection header received
0812 06:58:04.362178 (+ 2059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:04.362183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:04.362262 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:04.362352 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:04.363904 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:04.364648 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:04.366772 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:04.367184 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:04.367299 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:04.371021 (+ 3722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:04.371027 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:04.371031 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:04.371069 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:04.374099 (+ 3030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:04.374877 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:04.374883 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:04.374886 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:04.375043 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:04.375434 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:04.375438 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:04.375441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:04.375768 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:04.375904 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:04.376647 (+ 743us) server_negotiation.cc:299] Negotiation successful
0812 06:58:04.376861 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":245,"threads_started":1}
I20260812 06:58:04.378119 30018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:04.359116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43641 (local address 127.18.70.129:53803)
0812 06:58:04.359946 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:04.359998 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:04.361914 (+ 1916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:04.362615 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:04.362623 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:04.363126 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:04.363721 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:04.363746 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:04.364816 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:04.364822 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:04.366629 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:04.366644 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:04.367452 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:04.367461 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:04.367720 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:04.368364 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:04.368392 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:04.370796 (+ 2404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:04.374239 (+ 3443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:04.374245 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:04.374259 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:04.374737 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:04.375135 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:04.375138 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:04.375140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:04.375326 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:04.375881 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:04.375887 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:04.376216 (+ 329us) client_negotiation.cc:769] Sending connection context
0812 06:58:04.376478 (+ 262us) client_negotiation.cc:240] Negotiation successful
0812 06:58:04.376904 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":344,"threads_started":1}
I20260812 06:58:04.379738 30012 heartbeater.cc:347] Connected to a master server at 127.18.70.190:43641
I20260812 06:58:04.380079 30012 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:04.380861 30012 heartbeater.cc:511] Master 127.18.70.190:43641 requested a full tablet report, sending...
I20260812 06:58:04.382965 29602 ts_manager.cc:194] Registered new tserver with Master: 3a9da76ce51f47d3acc6a0ea0f2343a3 (127.18.70.129:43601)
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
I20260812 06:58:04.384425 29602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:53803
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 06:58:04.417487 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43641
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:36241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:04.788862 30025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:04.789191 30025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:04.789322 30025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:04.796988 30025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:04.797137 30025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:04.797314 30025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:58:04.807536 30025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:36241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:04.808887 30025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:04.810246 30025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:04.823671 30032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:04.823619 30036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:04.823560 30033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:04.824539 30025 server_base.cc:1034] running on GCE node
I20260812 06:58:04.825268 30025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:04.826335 30025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:04.827538 30025 hybrid_clock.cc:648] HybridClock initialized: now 1786517884827474 us; error 74 us; skew 500 ppm
I20260812 06:58:04.827847 30025 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:04 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517884, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:04.831377 30025 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:58:04.832898 30025 webserver.cc:460] Webserver started at http://127.18.70.130:45243/ using document root <none> and password file <none>
I20260812 06:58:04.833613 30025 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:04.833736 30025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:04.834110 30025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:04.837162 30025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "17299b7f793c4b7394c092ee87707ca4"
format_stamp: "Formatted at 2026-08-12 06:58:04 on dist-test-slave-tc2s"
server_key: "54809dda6b2f21aeb06da257de7e8944"
server_key_iv: "1d63d5f6b74896a6f020d365e700fefe"
server_key_version: "encryptionkey@0"
I20260812 06:58:04.838078 30025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "17299b7f793c4b7394c092ee87707ca4"
format_stamp: "Formatted at 2026-08-12 06:58:04 on dist-test-slave-tc2s"
server_key: "54809dda6b2f21aeb06da257de7e8944"
server_key_iv: "1d63d5f6b74896a6f020d365e700fefe"
server_key_version: "encryptionkey@0"
I20260812 06:58:04.843603 30025 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 06:58:04.847355 30045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:04.848733 30025 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 06:58:04.848904 30025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "17299b7f793c4b7394c092ee87707ca4"
format_stamp: "Formatted at 2026-08-12 06:58:04 on dist-test-slave-tc2s"
server_key: "54809dda6b2f21aeb06da257de7e8944"
server_key_iv: "1d63d5f6b74896a6f020d365e700fefe"
server_key_version: "encryptionkey@0"
I20260812 06:58:04.849124 30025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:04.870090 30025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:04.875046 30025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:04.875362 30025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:04.876703 30025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:04.878528 30025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:04.878618 30025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:04.878748 30025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:04.878801 30025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:04.911206 30025 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:33471
I20260812 06:58:04.911247 30278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:33471 every 8 connection(s)
I20260812 06:58:04.912550 30025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:58:04.918871 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 30025
I20260812 06:58:04.919083 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:58:04.919638 18714 external_mini_cluster.cc:1428] Setting key 7eaab7f041050b849a47887df454a36e
Aug 12 06:58:04 dist-test-slave-tc2s krb5kdc[29513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517884, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:04.934522 30281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:04.915181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:38921 (local address 127.18.70.190:43641)
0812 06:58:04.915612 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:04.915616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:04.916580 (+ 964us) server_negotiation.cc:407] Connection header received
0812 06:58:04.918703 (+ 2123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:04.918708 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:04.918781 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:04.918875 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:04.920857 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:04.921876 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:04.924238 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:04.924675 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:04.924770 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:04.928844 (+ 4074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:04.928850 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:04.928853 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:04.928886 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:04.931378 (+ 2492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:04.932162 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:04.932168 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:04.932172 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:04.932331 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:04.932726 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:04.932730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:04.932733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:04.933078 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:04.933219 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:04.933935 (+ 716us) server_negotiation.cc:299] Negotiation successful
0812 06:58:04.934165 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":215,"threads_started":1}
I20260812 06:58:04.935395 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:04.915670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43641 (local address 127.18.70.130:38921)
0812 06:58:04.916402 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:04.916461 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:04.918381 (+ 1920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:04.919161 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:04.919172 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:04.919899 (+ 727us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:04.920662 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:04.920687 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:04.922085 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:04.922092 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:04.924095 (+ 2003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:04.924112 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:04.924910 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:04.924917 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:04.925188 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:04.925915 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:04.925952 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:04.928601 (+ 2649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:04.931523 (+ 2922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:04.931533 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:04.931550 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:04.932035 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:04.932442 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:04.932445 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:04.932447 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:04.932631 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:04.933185 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:04.933191 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:04.933536 (+ 345us) client_negotiation.cc:769] Sending connection context
0812 06:58:04.933771 (+ 235us) client_negotiation.cc:240] Negotiation successful
0812 06:58:04.934235 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":287,"threads_started":1}
I20260812 06:58:04.936918 30279 heartbeater.cc:347] Connected to a master server at 127.18.70.190:43641
I20260812 06:58:04.937263 30279 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:04.938189 30279 heartbeater.cc:511] Master 127.18.70.190:43641 requested a full tablet report, sending...
I20260812 06:58:04.939893 29602 ts_manager.cc:194] Registered new tserver with Master: 17299b7f793c4b7394c092ee87707ca4 (127.18.70.130:33471)
I20260812 06:58:04.940833 29602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:38921
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 06:58:04.973119 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43641
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:36241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:05.318617 30291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:05.318959 30291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:05.319123 30291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:05.326614 30291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:05.326740 30291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:05.326907 30291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:58:05.336858 30291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:36241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:05.338313 30291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:05.339725 30291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:05.352415 30297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:05.352468 30298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:05.352682 30303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:05.353485 30291 server_base.cc:1034] running on GCE node
I20260812 06:58:05.354167 30291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:05.355159 30291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:05.356355 30291 hybrid_clock.cc:648] HybridClock initialized: now 1786517885356292 us; error 54 us; skew 500 ppm
I20260812 06:58:05.356669 30291 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:05.359773 30291 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:58:05.361260 30291 webserver.cc:460] Webserver started at http://127.18.70.131:42041/ using document root <none> and password file <none>
I20260812 06:58:05.361977 30291 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:05.362088 30291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:05.362367 30291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:05.365674 30291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "d3b8a0f2a7e149379593445317fd3906"
format_stamp: "Formatted at 2026-08-12 06:58:05 on dist-test-slave-tc2s"
server_key: "7f5eae62647eb5e5b630fdc5994ddcf8"
server_key_iv: "a07545d0dd4f3866ce679ffd7ba478ea"
server_key_version: "encryptionkey@0"
I20260812 06:58:05.366508 30291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "d3b8a0f2a7e149379593445317fd3906"
format_stamp: "Formatted at 2026-08-12 06:58:05 on dist-test-slave-tc2s"
server_key: "7f5eae62647eb5e5b630fdc5994ddcf8"
server_key_iv: "a07545d0dd4f3866ce679ffd7ba478ea"
server_key_version: "encryptionkey@0"
I20260812 06:58:05.371726 30291 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 06:58:05.375299 30314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:05.376710 30291 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 06:58:05.376868 30291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "d3b8a0f2a7e149379593445317fd3906"
format_stamp: "Formatted at 2026-08-12 06:58:05 on dist-test-slave-tc2s"
server_key: "7f5eae62647eb5e5b630fdc5994ddcf8"
server_key_iv: "a07545d0dd4f3866ce679ffd7ba478ea"
server_key_version: "encryptionkey@0"
I20260812 06:58:05.377074 30291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:05.387493 30012 heartbeater.cc:503] Master 127.18.70.190:43641 was elected leader, sending a full tablet report...
I20260812 06:58:05.399370 30291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:05.403724 30291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:05.404022 30291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:05.407291 30291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:05.409039 30291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:05.409137 30291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:05.409274 30291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:05.409334 30291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:05.443789 30291 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:37163
I20260812 06:58:05.443805 30573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:37163 every 8 connection(s)
I20260812 06:58:05.445120 30291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:58:05.446650 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 30291
I20260812 06:58:05.446830 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:58:05.447317 18714 external_mini_cluster.cc:1428] Setting key 557484484e549fcf9c1ad7efb367f6d2
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:05.468120 30580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:05.447886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:57019 (local address 127.18.70.190:43641)
0812 06:58:05.452552 (+ 4666us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:05.452556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:05.452572 (+ 16us) server_negotiation.cc:407] Connection header received
0812 06:58:05.452617 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:05.452621 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:05.452693 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:05.452784 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:05.454447 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.455246 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.456772 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.457179 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.457270 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:05.461946 (+ 4676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:05.461953 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:05.461958 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:05.462025 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:05.464778 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.465635 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.465640 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.465642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.465777 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.466274 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.466279 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.466281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.466608 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:05.466743 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:05.467571 (+ 828us) server_negotiation.cc:299] Negotiation successful
0812 06:58:05.467798 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4564,"thread_start_us":4460,"threads_started":1}
I20260812 06:58:05.469205 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:05.448479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43641 (local address 127.18.70.131:57019)
0812 06:58:05.449583 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:05.449635 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:05.451651 (+ 2016us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:05.453010 (+ 1359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:05.453021 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:05.453617 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:05.454275 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:05.454297 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.455417 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.455421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:05.456640 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:05.456654 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.457358 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.457363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:05.457588 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:05.458522 (+ 934us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:05.458576 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:05.461664 (+ 3088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:05.464945 (+ 3281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:05.464953 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:05.464968 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:05.465478 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:05.465869 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:05.465873 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:05.465876 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:05.466131 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:05.466757 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:05.466764 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:05.467123 (+ 359us) client_negotiation.cc:769] Sending connection context
0812 06:58:05.467383 (+ 260us) client_negotiation.cc:240] Negotiation successful
0812 06:58:05.467933 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":773,"thread_start_us":501,"threads_started":1}
I20260812 06:58:05.471256 30575 heartbeater.cc:347] Connected to a master server at 127.18.70.190:43641
I20260812 06:58:05.471624 30575 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:05.472386 30575 heartbeater.cc:511] Master 127.18.70.190:43641 requested a full tablet report, sending...
I20260812 06:58:05.474269 29602 ts_manager.cc:194] Registered new tserver with Master: d3b8a0f2a7e149379593445317fd3906 (127.18.70.131:37163)
I20260812 06:58:05.475446 29602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:57019
I20260812 06:58:05.476528 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/test-admin.keytab.
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:05.507330 18714 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 06:58:05.512535 30590 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:05.509854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50318 (local address 127.18.70.129:43601)
0812 06:58:05.510511 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:05.510520 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:05.510555 (+ 35us) server_negotiation.cc:407] Connection header received
0812 06:58:05.510632 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:05.510639 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:05.510859 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:05.511003 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:05.512065 (+ 1062us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50318: BlockingRecv error: recv got EOF from 127.0.0.1:50318 (error 108)
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":262,"threads_started":1}
W20260812 06:58:05.512665 18714 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5cc' of type FILE
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:05.514305 18714 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:05.515653 18714 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:58:05.530857 30590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:05.517224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50326 (local address 127.18.70.129:43601)
0812 06:58:05.517430 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:05.517436 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:05.517702 (+ 266us) server_negotiation.cc:407] Connection header received
0812 06:58:05.517837 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:05.517842 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:05.517925 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:05.518022 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:05.519036 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.520051 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.521239 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.521822 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.521953 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:05.525403 (+ 3450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:05.525415 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:05.525432 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:05.525465 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:05.528255 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.528934 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.528941 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.528943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.529069 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.529389 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.529392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.529394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.529737 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:05.530013 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:05.530324 (+ 311us) server_negotiation.cc:299] Negotiation successful
0812 06:58:05.530566 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260812 06:58:05.536825 30590 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:05.535052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50334 (local address 127.18.70.129:43601)
0812 06:58:05.535253 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:05.535259 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:05.535435 (+ 176us) server_negotiation.cc:407] Connection header received
0812 06:58:05.535594 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:05.535598 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:05.535659 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:05.535743 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:05.536586 (+ 843us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50334: BlockingRecv error: recv got EOF from 127.0.0.1:50334 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 06:58:05.537307 18714 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5cc)
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:05.538981 18714 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:05.540345 18714 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:58:05.555294 30590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:05.541731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50350 (local address 127.18.70.129:43601)
0812 06:58:05.541981 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:05.541987 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:05.542232 (+ 245us) server_negotiation.cc:407] Connection header received
0812 06:58:05.542342 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:05.542346 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:05.542409 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:05.542495 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:05.543403 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.544137 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.545979 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.546480 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.546595 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:05.550479 (+ 3884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:05.550483 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:05.550487 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:05.550523 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:05.552905 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.553581 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.553586 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.553588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.553719 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.554091 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.554095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.554098 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.554376 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:05.554587 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:05.554801 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 06:58:05.554979 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260812 06:58:05.559504 30590 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:05.558091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50354 (local address 127.18.70.129:43601)
0812 06:58:05.558273 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:05.558278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:05.558366 (+ 88us) server_negotiation.cc:407] Connection header received
0812 06:58:05.558493 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:05.558497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:05.558566 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:05.558643 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:05.559246 (+ 603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50354: BlockingRecv error: recv got EOF from 127.0.0.1:50354 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260812 06:58:05.559620 18714 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786517832212618-18714-0/krb5kdc/krb5cc' of type FILE
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:05.561084 18714 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:05.562325 18714 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:58:05.577831 30590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:05.563674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50364 (local address 127.18.70.129:43601)
0812 06:58:05.563856 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:05.563861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:05.564002 (+ 141us) server_negotiation.cc:407] Connection header received
0812 06:58:05.564143 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:05.564148 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:05.564210 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:05.564286 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:05.565218 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.565998 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.567204 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.567622 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.567727 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:05.571197 (+ 3470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:05.571203 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:05.571207 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:05.571238 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:05.574703 (+ 3465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.575468 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.575474 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.575478 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.575670 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.576065 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.576070 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.576073 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.576448 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:05.576788 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:05.576989 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 06:58:05.577222 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 06:58:05.582933 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 29738
I20260812 06:58:05.595059 30590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:05.583723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50370 (local address 127.18.70.129:43601)
0812 06:58:05.583880 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:05.583885 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:05.584252 (+ 367us) server_negotiation.cc:407] Connection header received
0812 06:58:05.584399 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:05.584405 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:05.584479 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:05.584569 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:05.585635 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.586373 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.587588 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.588020 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.588124 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:05.590136 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:05.590142 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:05.590145 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:05.590177 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:05.592535 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.593196 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.593200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.593203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.593345 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.593719 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.593722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.593725 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.594068 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:05.594289 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:05.594560 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 06:58:05.594735 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:58:05.595685 29998 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:05.680198 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 29738
I20260812 06:58:05.707288 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 30025
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 06:58:05.722066 30613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:05.708156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58362 (local address 127.18.70.130:33471)
0812 06:58:05.708651 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:05.708658 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:05.708685 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:58:05.708753 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:05.708759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:05.708967 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:05.709092 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:05.710051 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.711025 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.712189 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.712726 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.712826 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:05.716607 (+ 3781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:05.716618 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:05.716631 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:05.716663 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:05.719581 (+ 2918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.720203 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.720210 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.720212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.720346 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.720632 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.720634 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.720636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.720957 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:05.721193 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:05.721464 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 06:58:05.721685 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":254,"threads_started":1}
I20260812 06:58:05.723368 30271 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:05.805023 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 30025
I20260812 06:58:05.828145 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 30291
Aug 12 06:58:05 dist-test-slave-tc2s krb5kdc[29513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 06:58:05.844285 30615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:05.829117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38412 (local address 127.18.70.131:37163)
0812 06:58:05.829775 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:05.829782 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:05.829812 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:58:05.829886 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:05.829922 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:05.830142 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:05.830296 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:05.831362 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.832413 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.833659 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:05.834331 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:05.834445 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:05.838440 (+ 3995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:05.838453 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:05.838470 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:05.838511 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:05.841445 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.842208 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.842216 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.842219 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.842352 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:05.842738 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:05.842742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:05.842744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:05.843118 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:05.843449 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:05.843707 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 06:58:05.843979 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":348,"threads_started":1}
I20260812 06:58:05.845793 30569 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:05.929814 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 30291
I20260812 06:58:05.953125 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 29543
I20260812 06:58:05.954396 29676 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:06.063371 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 29543
2026-08-12T06:58:06Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4311 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:58:06 dist-test-slave-tc2s krb5kdc[30621](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:58:06 dist-test-slave-tc2s krb5kdc[30621](info): set up 2 sockets
Aug 12 06:58:06 dist-test-slave-tc2s krb5kdc[30621](info): commencing operation
krb5kdc: starting...
W20260812 06:58:07.448779 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.327s user 0.002s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:58:07 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:58:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:58:07Z Disabled control of system clock
WARNING: no policy specified for oryx/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.190.keytab.
Entry for principal oryx/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.190.keytab.
I20260812 06:58:07.743263 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41895
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.190.keytab
--principal=oryx/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:41895
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:08.103688 30648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:08.103989 30648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:08.104104 30648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:08.111505 30648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:58:08.111609 30648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:08.111685 30648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:08.111760 30648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:58:08.111814 30648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:58:08.121759 30648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:41895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.190.keytab
--principal=oryx/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:08.123167 30648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:08.124571 30648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:08.137353 30659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:08.137411 30666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:08.137432 30663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:08.138971 30648 server_base.cc:1034] running on GCE node
I20260812 06:58:08.139727 30648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:08.141180 30648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:08.142477 30648 hybrid_clock.cc:648] HybridClock initialized: now 1786517888142402 us; error 62 us; skew 500 ppm
I20260812 06:58:08.142866 30648 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:08 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517888, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:08.148921 30648 init.cc:377] Logged in from keytab as oryx/127.18.70.190@KRBTEST.COM (short username oryx)
I20260812 06:58:08.150650 30648 webserver.cc:460] Webserver started at http://127.18.70.190:41221/ using document root <none> and password file <none>
I20260812 06:58:08.151352 30648 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:08.151469 30648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:08.151805 30648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:08.155020 30648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "11de1582002747b0aee38b0a00cac210"
format_stamp: "Formatted at 2026-08-12 06:58:08 on dist-test-slave-tc2s"
server_key: "d13242abae4d3bbfcbc01225cee08bb1"
server_key_iv: "7d314203ef256de8b4a6aae7321e84e8"
server_key_version: "encryptionkey@0"
I20260812 06:58:08.155819 30648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "11de1582002747b0aee38b0a00cac210"
format_stamp: "Formatted at 2026-08-12 06:58:08 on dist-test-slave-tc2s"
server_key: "d13242abae4d3bbfcbc01225cee08bb1"
server_key_iv: "7d314203ef256de8b4a6aae7321e84e8"
server_key_version: "encryptionkey@0"
I20260812 06:58:08.161295 30648 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 06:58:08.164856 30681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:08.166500 30648 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:58:08.166656 30648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "11de1582002747b0aee38b0a00cac210"
format_stamp: "Formatted at 2026-08-12 06:58:08 on dist-test-slave-tc2s"
server_key: "d13242abae4d3bbfcbc01225cee08bb1"
server_key_iv: "7d314203ef256de8b4a6aae7321e84e8"
server_key_version: "encryptionkey@0"
I20260812 06:58:08.166847 30648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:08.196959 30648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:08.201715 30648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:08.202024 30648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:08.220856 30648 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:41895
I20260812 06:58:08.220888 30779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:41895 every 8 connection(s)
I20260812 06:58:08.222260 30648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:58:08.224192 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 30648
I20260812 06:58:08.224426 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:58:08.225265 18714 external_mini_cluster.cc:1428] Setting key fb18688184671195e1ea380fe4caa19b
I20260812 06:58:08.226524 30782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:08.240440 30782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210: Bootstrap starting.
Aug 12 06:58:08 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:08.243613 30782 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:08.244745 30782 log.cc:824] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:08.247540 30782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210: No bootstrap required, opened a new log
I20260812 06:58:08.250748 30789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:08.227379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55852 (local address 127.18.70.190:41895)
0812 06:58:08.228131 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:08.228143 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:08.228183 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:58:08.229732 (+ 1549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:08.229754 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:08.230190 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:08.230504 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:08.232560 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:08.234187 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:08.235889 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:08.236583 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:08.236734 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:08.242459 (+ 5725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:08.242471 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:08.242494 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:08.242557 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:08.246192 (+ 3635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:08.247206 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:08.247214 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:08.247221 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:08.247430 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:08.247877 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:08.247881 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:08.247883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:08.248442 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:08.248776 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:08.249240 (+ 464us) server_negotiation.cc:299] Negotiation successful
0812 06:58:08.249685 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":330,"threads_started":1}
I20260812 06:58:08.255264 30782 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } }
I20260812 06:58:08.255628 30782 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:08.255718 30782 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11de1582002747b0aee38b0a00cac210, State: Initialized, Role: FOLLOWER
I20260812 06:58:08.256218 30782 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } }
I20260812 06:58:08.256454 30782 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:58:08.256596 30782 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:58:08.256783 30782 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:08.258894 30782 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } }
I20260812 06:58:08.259394 30782 leader_election.cc:302] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11de1582002747b0aee38b0a00cac210; no voters:
I20260812 06:58:08.260109 30782 leader_election.cc:288] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:58:08.260437 30792 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:08.261175 30792 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 1 LEADER]: Becoming Leader. State: Replica: 11de1582002747b0aee38b0a00cac210, State: Running, Role: LEADER
I20260812 06:58:08.261693 30792 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } }
I20260812 06:58:08.262180 30782 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:58:08.264479 30793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } }
I20260812 06:58:08.264860 30793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:08.264796 30795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11de1582002747b0aee38b0a00cac210. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } }
I20260812 06:58:08.265087 30795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:08.266692 30809 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:58:08.271054 30809 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:58:08.279134 30809 catalog_manager.cc:1347] Generated new cluster ID: bcbaf79111ab42b08ea3692545479e35
I20260812 06:58:08.279230 30809 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:58:08.286653 30809 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:58:08.288401 30809 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:58:08.300108 30809 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210: Generated new TSK 0
I20260812 06:58:08.301117 30809 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab.
Entry for principal oryx/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab.
I20260812 06:58:08.367352 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41895
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab
--principal=oryx/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:08.706343 30831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:08.706646 30831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:08.706784 30831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:08.714001 30831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:08.714123 30831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:08.714274 30831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:58:08.724032 30831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab
--principal=oryx/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:08.725322 30831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:08.726696 30831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:08.739611 30847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:08.739624 30852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:08.739557 30849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:08.740469 30831 server_base.cc:1034] running on GCE node
I20260812 06:58:08.741014 30831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:08.741917 30831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:08.743181 30831 hybrid_clock.cc:648] HybridClock initialized: now 1786517888743110 us; error 37 us; skew 500 ppm
I20260812 06:58:08.743510 30831 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:08 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517888, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:08.750458 30831 init.cc:377] Logged in from keytab as oryx/127.18.70.129@KRBTEST.COM (short username oryx)
I20260812 06:58:08.751859 30831 webserver.cc:460] Webserver started at http://127.18.70.129:33805/ using document root <none> and password file <none>
I20260812 06:58:08.752532 30831 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:08.752650 30831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:08.752935 30831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:08.755962 30831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "0e2ba71074d645408b63648bfafd122c"
format_stamp: "Formatted at 2026-08-12 06:58:08 on dist-test-slave-tc2s"
server_key: "a82bd762bf3c0efacb4e416759c671fe"
server_key_iv: "beb7023d5cc140d8c9189ac2929cdf65"
server_key_version: "encryptionkey@0"
I20260812 06:58:08.756742 30831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "0e2ba71074d645408b63648bfafd122c"
format_stamp: "Formatted at 2026-08-12 06:58:08 on dist-test-slave-tc2s"
server_key: "a82bd762bf3c0efacb4e416759c671fe"
server_key_iv: "beb7023d5cc140d8c9189ac2929cdf65"
server_key_version: "encryptionkey@0"
I20260812 06:58:08.761873 30831 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 06:58:08.765477 30862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:08.766881 30831 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 06:58:08.767037 30831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "0e2ba71074d645408b63648bfafd122c"
format_stamp: "Formatted at 2026-08-12 06:58:08 on dist-test-slave-tc2s"
server_key: "a82bd762bf3c0efacb4e416759c671fe"
server_key_iv: "beb7023d5cc140d8c9189ac2929cdf65"
server_key_version: "encryptionkey@0"
I20260812 06:58:08.767215 30831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:08.797381 30831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:08.801684 30831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:08.801991 30831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:08.803011 30831 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:08.804353 30831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:08.804440 30831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:08.804563 30831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:08.804629 30831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:08.834609 30831 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:37567
I20260812 06:58:08.834653 31076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:37567 every 8 connection(s)
I20260812 06:58:08.835879 30831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:58:08.846192 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 30831
I20260812 06:58:08.846401 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:58:08.847013 18714 external_mini_cluster.cc:1428] Setting key 8201fd48951624d0e1646b4d73ec5bd4
Aug 12 06:58:08 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517888, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:08.854820 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:08.838455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:47483 (local address 127.18.70.190:41895)
0812 06:58:08.838900 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:08.838905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:08.839652 (+ 747us) server_negotiation.cc:407] Connection header received
0812 06:58:08.841446 (+ 1794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:08.841451 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:08.841530 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:08.841625 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:08.843095 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:08.843824 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:08.845319 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:08.845709 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:08.845819 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:08.849126 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:08.849132 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:08.849137 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:08.849175 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:08.852074 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:08.852712 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:08.852717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:08.852720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:08.852858 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:08.853228 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:08.853232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:08.853235 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:08.853539 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:08.853676 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:08.854299 (+ 623us) server_negotiation.cc:299] Negotiation successful
0812 06:58:08.854502 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":239,"threads_started":1}
I20260812 06:58:08.855543 31082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:08.838851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.129:47483)
0812 06:58:08.839507 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:08.839544 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:08.841179 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:08.841869 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:08.841879 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:08.842397 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:08.842936 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:08.842953 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:08.843979 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:08.843982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:08.845174 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:08.845186 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:08.845962 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:08.845971 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:08.846181 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:08.846811 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:08.846832 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:08.848922 (+ 2090us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:08.852203 (+ 3281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:08.852209 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:08.852219 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:08.852606 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:08.852963 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:08.852966 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:08.852969 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:08.853137 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:08.853640 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:08.853645 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:08.853961 (+ 316us) client_negotiation.cc:769] Sending connection context
0812 06:58:08.854179 (+ 218us) client_negotiation.cc:240] Negotiation successful
0812 06:58:08.854532 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":263,"threads_started":1}
I20260812 06:58:08.856874 31077 heartbeater.cc:347] Connected to a master server at 127.18.70.190:41895
I20260812 06:58:08.857184 31077 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:08.857860 31077 heartbeater.cc:511] Master 127.18.70.190:41895 requested a full tablet report, sending...
I20260812 06:58:08.859823 30715 ts_manager.cc:194] Registered new tserver with Master: 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567)
I20260812 06:58:08.861229 30715 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:47483
WARNING: no policy specified for oryx/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab.
Entry for principal oryx/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab.
I20260812 06:58:08.893725 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41895
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab
--principal=oryx/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:09.210762 31092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:09.211042 31092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:09.211169 31092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:09.218114 31092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:09.218220 31092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:09.218367 31092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:58:09.232223 31092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab
--principal=oryx/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:09.233623 31092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:09.235231 31092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:09.248893 31100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:09.248968 31103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:09.248910 31101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:09.250072 31092 server_base.cc:1034] running on GCE node
I20260812 06:58:09.250644 31092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:09.251508 31092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:09.252705 31092 hybrid_clock.cc:648] HybridClock initialized: now 1786517889252667 us; error 32 us; skew 500 ppm
I20260812 06:58:09.252991 31092 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:09 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517889, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:09.255995 31092 init.cc:377] Logged in from keytab as oryx/127.18.70.130@KRBTEST.COM (short username oryx)
I20260812 06:58:09.257257 31092 webserver.cc:460] Webserver started at http://127.18.70.130:43151/ using document root <none> and password file <none>
I20260812 06:58:09.257859 31092 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:09.258004 31092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:09.258261 31092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:09.261063 31092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "258730b2e0564b759cb81826c6cb54c0"
format_stamp: "Formatted at 2026-08-12 06:58:09 on dist-test-slave-tc2s"
server_key: "0c1b19dbc6dc867153c7878f1f1b0190"
server_key_iv: "1b0e296ef0aff58e4cde0d5730a5568e"
server_key_version: "encryptionkey@0"
I20260812 06:58:09.261826 31092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "258730b2e0564b759cb81826c6cb54c0"
format_stamp: "Formatted at 2026-08-12 06:58:09 on dist-test-slave-tc2s"
server_key: "0c1b19dbc6dc867153c7878f1f1b0190"
server_key_iv: "1b0e296ef0aff58e4cde0d5730a5568e"
server_key_version: "encryptionkey@0"
I20260812 06:58:09.266695 31092 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 06:58:09.269982 31113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:09.271608 31092 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260812 06:58:09.271763 31092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "258730b2e0564b759cb81826c6cb54c0"
format_stamp: "Formatted at 2026-08-12 06:58:09 on dist-test-slave-tc2s"
server_key: "0c1b19dbc6dc867153c7878f1f1b0190"
server_key_iv: "1b0e296ef0aff58e4cde0d5730a5568e"
server_key_version: "encryptionkey@0"
I20260812 06:58:09.271991 31092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:09.296864 31092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:09.300979 31092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:09.301244 31092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:09.302182 31092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:09.303509 31092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:09.303587 31092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:09.303709 31092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:09.303763 31092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:09.332926 31092 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:38021
I20260812 06:58:09.332973 31318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:38021 every 8 connection(s)
I20260812 06:58:09.334182 31092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:58:09.340847 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 31092
I20260812 06:58:09.341027 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:58:09.341429 18714 external_mini_cluster.cc:1428] Setting key 263133f1ecf6ac5b79edada535312bba
Aug 12 06:58:09 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517889, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:09.352916 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:09.336600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:33395 (local address 127.18.70.190:41895)
0812 06:58:09.336768 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:09.336773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:09.337845 (+ 1072us) server_negotiation.cc:407] Connection header received
0812 06:58:09.339605 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:09.339610 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:09.339680 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:09.339769 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:09.341185 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:09.341991 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:09.343759 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:09.344183 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:09.344291 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:09.347542 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:09.347547 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:09.347550 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:09.347580 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:09.350058 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:09.350727 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:09.350733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:09.350736 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:09.350859 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:09.351269 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:09.351273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:09.351275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:09.351583 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:09.351732 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:09.352365 (+ 633us) server_negotiation.cc:299] Negotiation successful
0812 06:58:09.352603 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 06:58:09.353736 31322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:09.336990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.130:33395)
0812 06:58:09.337689 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:09.337726 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:09.339347 (+ 1621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:09.339955 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:09.339962 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:09.340458 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:09.341023 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:09.341044 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:09.342139 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:09.342143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:09.343606 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:09.343619 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:09.344392 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:09.344400 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:09.344617 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:09.345242 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:09.345264 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:09.347326 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:09.350186 (+ 2860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:09.350196 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:09.350211 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:09.350615 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:09.350966 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:09.350971 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:09.350975 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:09.351164 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:09.351716 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:09.351723 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:09.352023 (+ 300us) client_negotiation.cc:769] Sending connection context
0812 06:58:09.352249 (+ 226us) client_negotiation.cc:240] Negotiation successful
0812 06:58:09.352668 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":254,"threads_started":1}
I20260812 06:58:09.355209 31319 heartbeater.cc:347] Connected to a master server at 127.18.70.190:41895
I20260812 06:58:09.355530 31319 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:09.356431 31319 heartbeater.cc:511] Master 127.18.70.190:41895 requested a full tablet report, sending...
I20260812 06:58:09.358040 30715 ts_manager.cc:194] Registered new tserver with Master: 258730b2e0564b759cb81826c6cb54c0 (127.18.70.130:38021)
I20260812 06:58:09.358842 30715 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:33395
WARNING: no policy specified for oryx/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab.
Entry for principal oryx/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab.
I20260812 06:58:09.389742 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41895
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab
--principal=oryx/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:09.707006 31327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:09.707271 31327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:09.707412 31327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:09.714334 31327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:09.714445 31327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:09.714586 31327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:58:09.723992 31327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab
--principal=oryx/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:09.725180 31327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:09.726493 31327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:09.738818 31337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:09.738765 31340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:09.738850 31346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:09.739598 31327 server_base.cc:1034] running on GCE node
I20260812 06:58:09.740166 31327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:09.741042 31327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:09.742229 31327 hybrid_clock.cc:648] HybridClock initialized: now 1786517889742184 us; error 35 us; skew 500 ppm
I20260812 06:58:09.742525 31327 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:09 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517889, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:09.745440 31327 init.cc:377] Logged in from keytab as oryx/127.18.70.131@KRBTEST.COM (short username oryx)
I20260812 06:58:09.746803 31327 webserver.cc:460] Webserver started at http://127.18.70.131:41899/ using document root <none> and password file <none>
I20260812 06:58:09.747464 31327 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:09.747576 31327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:09.747853 31327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:09.750679 31327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "aee6353114354080b7ebeb966697632d"
format_stamp: "Formatted at 2026-08-12 06:58:09 on dist-test-slave-tc2s"
server_key: "65ed2221edfecf856c2c990e75b9b28f"
server_key_iv: "1ec04752ae8f0a3ca37b391f4a898aa4"
server_key_version: "encryptionkey@0"
I20260812 06:58:09.751427 31327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "aee6353114354080b7ebeb966697632d"
format_stamp: "Formatted at 2026-08-12 06:58:09 on dist-test-slave-tc2s"
server_key: "65ed2221edfecf856c2c990e75b9b28f"
server_key_iv: "1ec04752ae8f0a3ca37b391f4a898aa4"
server_key_version: "encryptionkey@0"
I20260812 06:58:09.756327 31327 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260812 06:58:09.759593 31356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:09.760828 31327 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:58:09.760978 31327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "aee6353114354080b7ebeb966697632d"
format_stamp: "Formatted at 2026-08-12 06:58:09 on dist-test-slave-tc2s"
server_key: "65ed2221edfecf856c2c990e75b9b28f"
server_key_iv: "1ec04752ae8f0a3ca37b391f4a898aa4"
server_key_version: "encryptionkey@0"
I20260812 06:58:09.761154 31327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:09.777007 31327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:09.780680 31327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:09.780928 31327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:09.781810 31327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:09.783080 31327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:09.783156 31327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:09.783277 31327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:09.783329 31327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:09.813059 31327 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:35691
I20260812 06:58:09.813088 31577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:35691 every 8 connection(s)
I20260812 06:58:09.814306 31327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:58:09.817051 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 31327
I20260812 06:58:09.817224 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:58:09.817651 18714 external_mini_cluster.cc:1428] Setting key 4fc7080bc7d4e5af4606b3245f9398a5
Aug 12 06:58:09 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517889, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:09.832829 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:09.816732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:37373 (local address 127.18.70.190:41895)
0812 06:58:09.816962 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:09.816969 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:09.818127 (+ 1158us) server_negotiation.cc:407] Connection header received
0812 06:58:09.820124 (+ 1997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:09.820128 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:09.820200 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:09.820333 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:09.821949 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:09.822715 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:09.824167 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:09.824560 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:09.824647 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:09.827773 (+ 3126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:09.827778 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:09.827781 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:09.827812 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:09.830057 (+ 2245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:09.830654 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:09.830676 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:09.830678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:09.830806 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:09.831220 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:09.831224 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:09.831226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:09.831525 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:09.831680 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:09.832378 (+ 698us) server_negotiation.cc:299] Negotiation successful
0812 06:58:09.832596 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 06:58:09.833669 31581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:09.817115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.131:37373)
0812 06:58:09.817957 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:09.818010 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:09.819849 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:09.820699 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:09.820708 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:09.821193 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:09.821758 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:09.821776 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:09.822857 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:09.822861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:09.824054 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:09.824066 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:09.824716 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:09.824720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:09.824922 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:09.825529 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:09.825550 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:09.827585 (+ 2035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:09.830165 (+ 2580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:09.830171 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:09.830181 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:09.830556 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:09.830920 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:09.830923 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:09.830926 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:09.831104 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:09.831654 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:09.831660 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:09.832022 (+ 362us) client_negotiation.cc:769] Sending connection context
0812 06:58:09.832242 (+ 220us) client_negotiation.cc:240] Negotiation successful
0812 06:58:09.832697 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":322,"threads_started":1}
I20260812 06:58:09.835047 31579 heartbeater.cc:347] Connected to a master server at 127.18.70.190:41895
I20260812 06:58:09.835338 31579 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:09.836031 31579 heartbeater.cc:511] Master 127.18.70.190:41895 requested a full tablet report, sending...
I20260812 06:58:09.837450 30715 ts_manager.cc:194] Registered new tserver with Master: aee6353114354080b7ebeb966697632d (127.18.70.131:35691)
I20260812 06:58:09.838550 30715 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:37373
I20260812 06:58:09.844542 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:58:09.864111 31077 heartbeater.cc:503] Master 127.18.70.190:41895 was elected leader, sending a full tablet report...
WARNING: no policy specified for oryx/127.18.70.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.189.keytab.
Entry for principal oryx/127.18.70.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.189.keytab.
I20260812 06:58:09.893172 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.189:44517
--webserver_interface=127.18.70.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.189.keytab
--principal=oryx/127.18.70.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:41895,127.18.70.189:44517
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:10.214355 31584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:10.214635 31584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:10.214754 31584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:10.223042 31584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:58:10.223160 31584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:10.223232 31584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:10.223304 31584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:58:10.223361 31584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:58:10.236161 31584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:41895,127.18.70.189:44517
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.189.keytab
--principal=oryx/127.18.70.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.189:44517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.70.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
W20260812 06:58:10.236466 31584 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.18.70.190:41895,127.18.70.189:44517'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 06:58:10.237450 31584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:10.238703 31584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:10.249979 31605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:10.250111 31599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:10.250118 31600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:10.251102 31584 server_base.cc:1034] running on GCE node
I20260812 06:58:10.251834 31584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:10.253064 31584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:10.254266 31584 hybrid_clock.cc:648] HybridClock initialized: now 1786517890254202 us; error 41 us; skew 500 ppm
I20260812 06:58:10.254577 31584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:10 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517890, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:10.257545 31584 init.cc:377] Logged in from keytab as oryx/127.18.70.189@KRBTEST.COM (short username oryx)
I20260812 06:58:10.258924 31584 webserver.cc:460] Webserver started at http://127.18.70.189:38043/ using document root <none> and password file <none>
I20260812 06:58:10.259599 31584 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:10.259683 31584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:10.259938 31584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:10.262816 31584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data/instance:
uuid: "511926043ba14cb7a6a534d10fe668c4"
format_stamp: "Formatted at 2026-08-12 06:58:10 on dist-test-slave-tc2s"
server_key: "4c8bb4be6a1b80f8e425212f8d4c06b1"
server_key_iv: "a9d48d80ac466f74b41d3aa57f6b3989"
server_key_version: "encryptionkey@0"
I20260812 06:58:10.263551 31584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/wal/instance:
uuid: "511926043ba14cb7a6a534d10fe668c4"
format_stamp: "Formatted at 2026-08-12 06:58:10 on dist-test-slave-tc2s"
server_key: "4c8bb4be6a1b80f8e425212f8d4c06b1"
server_key_iv: "a9d48d80ac466f74b41d3aa57f6b3989"
server_key_version: "encryptionkey@0"
I20260812 06:58:10.268589 31584 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 06:58:10.271828 31620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:10.273032 31584 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 06:58:10.273165 31584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/wal
uuid: "511926043ba14cb7a6a534d10fe668c4"
format_stamp: "Formatted at 2026-08-12 06:58:10 on dist-test-slave-tc2s"
server_key: "4c8bb4be6a1b80f8e425212f8d4c06b1"
server_key_iv: "a9d48d80ac466f74b41d3aa57f6b3989"
server_key_version: "encryptionkey@0"
I20260812 06:58:10.273355 31584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:10.294581 31584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:10.298556 31584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:10.298760 31584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:10.315161 31584 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.189:44517
I20260812 06:58:10.315178 31718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.189:44517 every 8 connection(s)
I20260812 06:58:10.316376 31584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
I20260812 06:58:10.319168 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 31584
I20260812 06:58:10.319897 31720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:10.329427 31720 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:58:10 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.70.189@KRBTEST.COM
Aug 12 06:58:10 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517890, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.189@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:10.343972 31727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.321316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32890 (local address 127.18.70.189:44517)
0812 06:58:10.322174 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:10.322190 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:10.322237 (+ 47us) server_negotiation.cc:407] Connection header received
0812 06:58:10.324490 (+ 2253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:10.324519 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:10.324991 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:10.325424 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:10.326760 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.328685 (+ 1925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.329855 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.330878 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.331057 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.335556 (+ 4499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:10.335565 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:10.335578 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:10.335625 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:10.339362 (+ 3737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.340118 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.340124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.340129 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.340283 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.340702 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.340707 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.340710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.341351 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:10.341606 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:10.342542 (+ 936us) server_negotiation.cc:299] Negotiation successful
0812 06:58:10.342824 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":352,"threads_started":1}
I20260812 06:58:10.347522 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.332133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55856 (local address 127.18.70.190:41895)
0812 06:58:10.332331 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:10.332336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:10.333142 (+ 806us) server_negotiation.cc:407] Connection header received
0812 06:58:10.333421 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:10.333428 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:10.333514 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:10.333629 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:10.335039 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.336114 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.337527 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.338105 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.338223 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.341519 (+ 3296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:10.341524 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:10.341527 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:10.341564 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:10.344687 (+ 3123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.345480 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.345485 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.345488 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.345664 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.346017 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.346022 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.346025 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.346432 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:10.346588 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:10.347020 (+ 432us) server_negotiation.cc:299] Negotiation successful
0812 06:58:10.347213 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 06:58:10.347584 31729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.332071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:55856)
0812 06:58:10.332989 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:10.333045 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:10.333267 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:10.333704 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:10.333711 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:10.334544 (+ 833us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:10.334855 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.334867 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.336261 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.336266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.337381 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.337394 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.338270 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.338276 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.338447 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.338962 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:10.338978 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:10.341360 (+ 2382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:10.344810 (+ 3450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.344820 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.344827 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.345361 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.345763 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.345766 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.345768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.345878 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.346575 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:10.346582 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:10.346745 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 06:58:10.346903 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 06:58:10.347199 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":534,"threads_started":1}
I20260812 06:58:10.348958 31720 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:58:10 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517890, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.189@KRBTEST.COM for oryx/127.18.70.189@KRBTEST.COM
I20260812 06:58:10.359670 31729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.349653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:44517 (local address 127.0.0.1:32902)
0812 06:58:10.349864 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:10.349877 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:10.349991 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:10.350212 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:10.350215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:10.350498 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:10.350621 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.350628 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.351487 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.351490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.352322 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.352332 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.352920 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.352924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.353047 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.353459 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:10.353473 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:10.355289 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:10.357781 (+ 2492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.357784 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.357786 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.358207 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.358478 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.358481 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.358483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.358597 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.359050 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:10.359053 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:10.359170 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 06:58:10.359267 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 06:58:10.359449 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149}
I20260812 06:58:10.359838 31727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.349649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32902 (local address 127.18.70.189:44517)
0812 06:58:10.349788 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:10.349792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:10.349948 (+ 156us) server_negotiation.cc:407] Connection header received
0812 06:58:10.350069 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:10.350072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:10.350122 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:10.350190 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:10.350727 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.351371 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.352437 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.352806 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.352890 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.355435 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:10.355439 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:10.355443 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:10.355469 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:10.357679 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.358294 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.358298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.358300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.358401 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.358683 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.358686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.358688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.358952 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:10.359061 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:10.359354 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 06:58:10.359564 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":51}
I20260812 06:58:10.361927 31319 heartbeater.cc:503] Master 127.18.70.190:41895 was elected leader, sending a full tablet report...
I20260812 06:58:10.364470 31720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: Bootstrap starting.
I20260812 06:58:10.367694 31720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:10.368680 31720 log.cc:824] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:10.371282 31720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: No bootstrap required, opened a new log
I20260812 06:58:10.378365 31720 raft_consensus.cc:348] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } }
I20260812 06:58:10.378695 31720 raft_consensus.cc:374] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:10.378798 31720 raft_consensus.cc:729] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511926043ba14cb7a6a534d10fe668c4, State: Initialized, Role: FOLLOWER
I20260812 06:58:10.379305 31720 consensus_queue.cc:260] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } }
I20260812 06:58:10.380081 31731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } } }
I20260812 06:58:10.380363 31731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:58:10.381017 31720 sys_catalog.cc:564] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 06:58:10.388656 31758 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:58:10.388765 31758 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:58:10.391376 31584 master_runner.cc:428] Detected that this master 511926043ba14cb7a6a534d10fe668c4 is joining an existing cluster
I20260812 06:58:10.391458 31584 master_runner.cc:432] Initiating AddMaster RPC to add 127.18.70.189:44517
I20260812 06:58:10.411461 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.395022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55858 (local address 127.18.70.190:41895)
0812 06:58:10.395408 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:10.395414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:10.396020 (+ 606us) server_negotiation.cc:407] Connection header received
0812 06:58:10.396328 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:10.396334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:10.396421 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:10.396525 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:10.398060 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.399143 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.401244 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.401885 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.402004 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.404723 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:10.404729 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:10.404733 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:10.404768 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:10.408300 (+ 3532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.409189 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.409194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.409198 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.409357 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.409818 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.409822 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.409826 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.410189 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:10.410297 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:10.410925 (+ 628us) server_negotiation.cc:299] Negotiation successful
0812 06:58:10.411141 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262}
I20260812 06:58:10.411463 31727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.395006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32914 (local address 127.18.70.189:44517)
0812 06:58:10.395254 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:10.395263 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:10.396368 (+ 1105us) server_negotiation.cc:407] Connection header received
0812 06:58:10.396492 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:10.396497 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:10.396555 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:10.396637 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:10.398055 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.399143 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.401230 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.401931 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.402025 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.404688 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:10.404695 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:10.404699 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:10.404731 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:10.408300 (+ 3569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.409258 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.409263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.409267 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.409427 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.409866 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.409871 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.409875 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.410252 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:10.410398 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:10.410888 (+ 490us) server_negotiation.cc:299] Negotiation successful
0812 06:58:10.411110 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 06:58:10.412673 31768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.395375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:44517 (local address 127.0.0.1:32914)
0812 06:58:10.396288 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:10.396303 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:10.396402 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:10.396783 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:10.396787 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:10.397431 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:10.397874 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.397915 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.399345 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.399349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.401093 (+ 1744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.401107 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.402337 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.402344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.402563 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.403187 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:10.403211 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:10.404541 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:10.408446 (+ 3905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.408452 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.408455 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.409126 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.409567 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.409574 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.409578 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.409755 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.410481 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:10.410486 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:10.410638 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 06:58:10.411868 (+ 1230us) client_negotiation.cc:240] Negotiation successful
0812 06:58:10.412202 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":791,"mutex_wait_us":147,"spinlock_wait_cycles":19328,"thread_start_us":611,"threads_started":1}
I20260812 06:58:10.413033 31766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.395057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:55858)
0812 06:58:10.395906 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:10.395926 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:10.396137 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:10.396546 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:10.396550 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:10.397354 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:10.397925 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.397935 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.399314 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.399319 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.401092 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.401107 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.402295 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.402301 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.402522 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.403304 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:10.403322 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:10.404516 (+ 1194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:10.408462 (+ 3946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.408466 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.408470 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.409056 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.409497 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.409512 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.409515 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.409693 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.410390 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:10.410395 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:10.410610 (+ 215us) client_negotiation.cc:769] Sending connection context
0812 06:58:10.411644 (+ 1034us) client_negotiation.cc:240] Negotiation successful
0812 06:58:10.412402 (+ 758us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"mutex_wait_us":340,"spinlock_wait_cycles":41600,"thread_start_us":558,"threads_started":1}
WARNING: no policy specified for oryx/127.18.70.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.188@KRBTEST.COM" created.
Aug 12 06:58:10 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517888, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.190@KRBTEST.COM for oryx/127.18.70.189@KRBTEST.COM
I20260812 06:58:10.433640 31727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.419718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32930 (local address 127.18.70.189:44517)
0812 06:58:10.419878 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:10.419884 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:10.420172 (+ 288us) server_negotiation.cc:407] Connection header received
0812 06:58:10.420656 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:10.420662 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:10.420748 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:10.420868 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:10.422291 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.423388 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.424822 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.425302 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.425412 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.428525 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:10.428530 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:10.428533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:10.428560 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:10.431099 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.431731 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.431735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.431737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.431863 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.432212 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.432218 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.432220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.432491 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:10.432633 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:10.433073 (+ 440us) server_negotiation.cc:299] Negotiation successful
0812 06:58:10.433279 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 06:58:10.433687 31773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.419432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:44517 (local address 127.0.0.1:32930)
0812 06:58:10.420044 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:10.420093 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:10.420389 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:10.420941 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:10.420949 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:10.421797 (+ 848us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:10.422123 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.422137 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.423579 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.423584 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.424685 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.424699 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.425455 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.425461 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.425651 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.426248 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:10.426276 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:10.428350 (+ 2074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:10.431224 (+ 2874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.431236 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.431244 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.431622 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.431964 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.431969 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.431973 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.432112 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.432625 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:10.432633 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:10.432791 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 06:58:10.432963 (+ 172us) client_negotiation.cc:240] Negotiation successful
0812 06:58:10.433274 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":456,"threads_started":1}
I20260812 06:58:10.435784 30715 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.18.70.189:44517: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "511926043ba14cb7a6a534d10fe668c4"
member_type: NON_VOTER
last_known_addr {
host: "127.18.70.189"
port: 44517
}
attrs {
promote: true
}
}
dest_uuid: "11de1582002747b0aee38b0a00cac210"
cas_config_opid_index: -1
I20260812 06:58:10.437455 30715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } }
I20260812 06:58:10.449148 31672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:10.450685 31779 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 511926043ba14cb7a6a534d10fe668c4 (127.18.70.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } } }
I20260812 06:58:10.452996 31672 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 FOLLOWER]: Refusing update from remote peer 11de1582002747b0aee38b0a00cac210: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 06:58:10.454344 31781 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:10.455112 31779 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.18.70.189:44517
I20260812 06:58:10.457504 31584 master.cc:537] Master@127.18.70.189:44517 shutting down...
W20260812 06:58:10.458591 30684 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.188.keytab.
Entry for principal oryx/127.18.70.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.188.keytab.
I20260812 06:58:10.461623 31783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } } }
I20260812 06:58:10.462035 31783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:10.462212 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.188:38149
--webserver_interface=127.18.70.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.188.keytab
--principal=oryx/127.18.70.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:41895,127.18.70.189:44517,127.18.70.188:38149
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:10.464294 30684 consensus_peers.cc:487] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 -> Peer 511926043ba14cb7a6a534d10fe668c4 (127.18.70.189:44517): Couldn't send request to peer 511926043ba14cb7a6a534d10fe668c4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:58:10.471385 31584 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:10.471786 31584 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:10.471987 31584 tablet_replica.cc:330] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: stopping tablet replica
I20260812 06:58:10.478826 31584 master.cc:552] Master@127.18.70.189:44517 shutdown complete.
I20260812 06:58:10.479019 31584 master_runner.cc:305] Clearing existing system tablet
I20260812 06:58:10.479573 31584 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:10.479730 31584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:10.483114 31584 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 06:58:10.485042 31796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:10.485399 31584 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:10.485821 31584 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 06:58:10.485982 31584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/wal
uuid: "511926043ba14cb7a6a534d10fe668c4"
format_stamp: "Formatted at 2026-08-12 06:58:10 on dist-test-slave-tc2s"
server_key: "4c8bb4be6a1b80f8e425212f8d4c06b1"
server_key_iv: "a9d48d80ac466f74b41d3aa57f6b3989"
server_key_version: "encryptionkey@0"
I20260812 06:58:10.490971 31584 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:10.498049 31584 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 06:58:10.498281 31584 log.cc:1196] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 06:58:10.498756 31584 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: Deleting consensus metadata
I20260812 06:58:10.499060 31584 master_runner.cc:315] Copying system tablet from 127.18.70.190:41895
I20260812 06:58:10.501576 31584 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: tablet copy: Beginning tablet copy session from remote peer at address 127.18.70.190:41895
I20260812 06:58:10.524446 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.502452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55870 (local address 127.18.70.190:41895)
0812 06:58:10.502627 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:10.502634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:10.510170 (+ 7536us) server_negotiation.cc:407] Connection header received
0812 06:58:10.510359 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:10.510365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:10.510468 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:10.510584 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:10.511730 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.512833 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.514679 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.515351 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.515484 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.517778 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:10.517786 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:10.517790 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:10.517831 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:10.521291 (+ 3460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.522198 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.522203 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.522207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.522367 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.522818 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.522823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.522827 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.523203 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:10.523366 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:10.523835 (+ 469us) server_negotiation.cc:299] Negotiation successful
0812 06:58:10.524106 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 06:58:10.524828 31807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.502393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:55870)
0812 06:58:10.510019 (+ 7626us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:10.510046 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:10.510215 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:10.510632 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:10.510637 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:10.511222 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:10.511537 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.511552 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.513001 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.513006 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.514513 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.514529 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.515531 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.515537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.515715 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.516471 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:10.516493 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:10.517552 (+ 1059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:10.521432 (+ 3880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.521438 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.521442 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.522056 (+ 614us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.522492 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.522497 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.522501 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.522690 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.523340 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:10.523345 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:10.523530 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 06:58:10.523710 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 06:58:10.524044 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7444,"thread_start_us":7325,"threads_started":1}
I20260812 06:58:10.525719 30751 tablet_copy_service.cc:140] P 11de1582002747b0aee38b0a00cac210: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 511926043ba14cb7a6a534d10fe668c4 ({username='oryx', principal='oryx/127.18.70.189@KRBTEST.COM'} at 127.0.0.1:55870)
I20260812 06:58:10.526084 30751 tablet_copy_service.cc:161] P 11de1582002747b0aee38b0a00cac210: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 511926043ba14cb7a6a534d10fe668c4 at {username='oryx', principal='oryx/127.18.70.189@KRBTEST.COM'} at 127.0.0.1:55870: session id = 511926043ba14cb7a6a534d10fe668c4-00000000000000000000000000000000
I20260812 06:58:10.530630 30751 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:58:10.532960 31584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 06:58:10.539729 31584 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: tablet copy: Starting download of 0 data blocks...
I20260812 06:58:10.540097 31584 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: tablet copy: Starting download of 1 WAL segments...
I20260812 06:58:10.542914 31584 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:58:10.547093 30751 tablet_copy_service.cc:342] P 11de1582002747b0aee38b0a00cac210: Request end of tablet copy session 511926043ba14cb7a6a534d10fe668c4-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.18.70.189@KRBTEST.COM'} at 127.0.0.1:55870
I20260812 06:58:10.547286 30751 tablet_copy_service.cc:433] P 11de1582002747b0aee38b0a00cac210: ending tablet copy session 511926043ba14cb7a6a534d10fe668c4-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 511926043ba14cb7a6a534d10fe668c4
I20260812 06:58:10.560141 31584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:10.562829 31808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:10.563215 31809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:10.572979 31584 server_base.cc:1034] running on GCE node
W20260812 06:58:10.573644 31812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:10.574251 31584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:10.574885 31584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:10.576102 31584 hybrid_clock.cc:648] HybridClock initialized: now 1786517890576028 us; error 43 us; skew 500 ppm
I20260812 06:58:10.576318 31584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:10 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517890, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:10.578485 31584 init.cc:377] Logged in from keytab as oryx/127.18.70.189@KRBTEST.COM (short username oryx)
I20260812 06:58:10.582777 31584 webserver.cc:460] Webserver started at http://127.18.70.189:33385/ using document root <none> and password file <none>
I20260812 06:58:10.583153 31584 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:10.583241 31584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:10.587473 31584 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260812 06:58:10.595916 31826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:10.596350 31584 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.000s sys 0.008s
I20260812 06:58:10.596489 31584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/wal
uuid: "511926043ba14cb7a6a534d10fe668c4"
format_stamp: "Formatted at 2026-08-12 06:58:10 on dist-test-slave-tc2s"
server_key: "4c8bb4be6a1b80f8e425212f8d4c06b1"
server_key_iv: "a9d48d80ac466f74b41d3aa57f6b3989"
server_key_version: "encryptionkey@0"
I20260812 06:58:10.596668 31584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:10.626955 31584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:10.630944 31584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:10.656116 31584 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.189:44517
I20260812 06:58:10.656147 31929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.189:44517 every 8 connection(s)
I20260812 06:58:10.657130 31584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
I20260812 06:58:10.662580 31930 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:58:10.666491 31930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: Bootstrap starting.
I20260812 06:58:10.683710 31930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:58:10.684253 31930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: Bootstrap complete.
I20260812 06:58:10.685340 31930 raft_consensus.cc:348] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } }
I20260812 06:58:10.685633 31930 raft_consensus.cc:729] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 511926043ba14cb7a6a534d10fe668c4, State: Initialized, Role: LEARNER
I20260812 06:58:10.685946 31930 consensus_queue.cc:260] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } }
I20260812 06:58:10.686793 31936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } } }
I20260812 06:58:10.687073 31930 sys_catalog.cc:564] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:58:10.687280 31936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: This master's current role is: LEARNER
I20260812 06:58:10.695746 31964 catalog_manager.cc:1259] Loaded cluster ID: bcbaf79111ab42b08ea3692545479e35
I20260812 06:58:10.695887 31964 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: loading cluster ID for follower catalog manager: success
I20260812 06:58:10.699340 31964 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: acquiring CA information for follower catalog manager: success
I20260812 06:58:10.701853 31964 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:58:10.840898 31579 heartbeater.cc:503] Master 127.18.70.190:41895 was elected leader, sending a full tablet report...
W20260812 06:58:10.851894 31792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:10.852164 31792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:10.852295 31792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:10.859782 31792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:58:10.859884 31792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:10.859958 31792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:10.860026 31792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:58:10.860082 31792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:58:10.870445 31792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:41895,127.18.70.189:44517,127.18.70.188:38149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.188.keytab
--principal=oryx/127.18.70.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.188:38149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.70.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:10.871909 31792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:10.873139 31792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:10.884639 31970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:10.884608 31971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:10.884629 31973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:10.885459 31792 server_base.cc:1034] running on GCE node
I20260812 06:58:10.886219 31792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:10.887527 31792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:10.888728 31792 hybrid_clock.cc:648] HybridClock initialized: now 1786517890888678 us; error 29 us; skew 500 ppm
I20260812 06:58:10.889081 31792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:10 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517890, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:10.892099 31792 init.cc:377] Logged in from keytab as oryx/127.18.70.188@KRBTEST.COM (short username oryx)
I20260812 06:58:10.893441 31792 webserver.cc:460] Webserver started at http://127.18.70.188:39925/ using document root <none> and password file <none>
I20260812 06:58:10.894131 31792 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:10.894249 31792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:10.894529 31792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:10.897528 31792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data/instance:
uuid: "650b2a15db3e447eb8f54de83b9aa779"
format_stamp: "Formatted at 2026-08-12 06:58:10 on dist-test-slave-tc2s"
server_key: "0ca9cf72a84aa6e610c82d3e8b40ba36"
server_key_iv: "baaa35e9091d3e5bf2e5df35781e078f"
server_key_version: "encryptionkey@0"
I20260812 06:58:10.898317 31792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/wal/instance:
uuid: "650b2a15db3e447eb8f54de83b9aa779"
format_stamp: "Formatted at 2026-08-12 06:58:10 on dist-test-slave-tc2s"
server_key: "0ca9cf72a84aa6e610c82d3e8b40ba36"
server_key_iv: "baaa35e9091d3e5bf2e5df35781e078f"
server_key_version: "encryptionkey@0"
I20260812 06:58:10.903239 31792 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 06:58:10.906466 31994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:10.907912 31792 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 06:58:10.908139 31792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/wal
uuid: "650b2a15db3e447eb8f54de83b9aa779"
format_stamp: "Formatted at 2026-08-12 06:58:10 on dist-test-slave-tc2s"
server_key: "0ca9cf72a84aa6e610c82d3e8b40ba36"
server_key_iv: "baaa35e9091d3e5bf2e5df35781e078f"
server_key_version: "encryptionkey@0"
I20260812 06:58:10.908310 31792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:10.925783 31792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:10.929864 31792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:10.930150 31792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:10.947844 31792 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.188:38149
I20260812 06:58:10.947866 32092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.188:38149 every 8 connection(s)
I20260812 06:58:10.949123 31792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
I20260812 06:58:10.952579 32094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:10.956799 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 31792
I20260812 06:58:10.959733 32094 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:58:10 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517890, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.188@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
Aug 12 06:58:10 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.70.188@KRBTEST.COM
I20260812 06:58:10.979095 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.963688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55874 (local address 127.18.70.190:41895)
0812 06:58:10.963892 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:10.963899 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:10.964492 (+ 593us) server_negotiation.cc:407] Connection header received
0812 06:58:10.964740 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:10.964747 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:10.964818 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:10.964900 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:10.966275 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.967079 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.968642 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.969145 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.969234 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.972929 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:10.972936 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:10.972941 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:10.972987 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:10.975750 (+ 2763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.976718 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.976722 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.976725 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.976880 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.977267 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.977272 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.977274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.977596 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:10.977743 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:10.978523 (+ 780us) server_negotiation.cc:299] Negotiation successful
0812 06:58:10.978742 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 06:58:10.980218 32101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.963566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:55874)
0812 06:58:10.964362 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:10.964408 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:10.964608 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:10.964998 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:10.965004 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:10.965781 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:10.966145 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.966156 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.967215 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.967221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.968508 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.968522 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.969384 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.969393 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.969573 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.970208 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:10.970238 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:10.972742 (+ 2504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:10.975927 (+ 3185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.975937 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.975949 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.976611 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.976987 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.976990 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.976992 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.977159 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.977716 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:10.977722 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:10.978142 (+ 420us) client_negotiation.cc:769] Sending connection context
0812 06:58:10.978438 (+ 296us) client_negotiation.cc:240] Negotiation successful
0812 06:58:10.978900 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":371,"threads_started":1}
I20260812 06:58:10.980237 32100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.959100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43798 (local address 127.18.70.188:38149)
0812 06:58:10.959971 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:10.959982 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:10.960025 (+ 43us) server_negotiation.cc:407] Connection header received
0812 06:58:10.961784 (+ 1759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:10.961815 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:10.962304 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:10.962672 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:10.964534 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.966077 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.967450 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.968088 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.968217 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.973549 (+ 5332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:10.973557 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:10.973571 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:10.973599 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:10.976607 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.977278 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.977284 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.977286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.977407 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.977806 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.977810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.977813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.978298 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:10.978586 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:10.978898 (+ 312us) server_negotiation.cc:299] Negotiation successful
0812 06:58:10.979111 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":368,"threads_started":1}
I20260812 06:58:10.981796 32094 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:58:10 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517890, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.188@KRBTEST.COM for oryx/127.18.70.189@KRBTEST.COM
I20260812 06:58:10.993825 32101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.982415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:44517 (local address 127.0.0.1:32934)
0812 06:58:10.982611 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:10.982630 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:10.982731 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:10.983726 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:10.983729 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:10.984032 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:10.984160 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.984168 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.985356 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.985360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.986303 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.986314 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.986927 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.986931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.987095 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.987542 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:10.987557 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:10.989369 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:10.992016 (+ 2647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.992019 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.992022 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.992382 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.992689 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:10.992692 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:10.992695 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:10.992814 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:10.993186 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:10.993189 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:10.993296 (+ 107us) client_negotiation.cc:769] Sending connection context
0812 06:58:10.993411 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 06:58:10.993602 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 06:58:10.993921 32102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.982636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32934 (local address 127.18.70.189:44517)
0812 06:58:10.983464 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:10.983468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:10.983483 (+ 15us) server_negotiation.cc:407] Connection header received
0812 06:58:10.983542 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:10.983546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:10.983603 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:10.983685 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:10.984266 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.985252 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.986415 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.986815 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.986900 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.989553 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:10.989559 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:10.989562 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:10.989594 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:10.991901 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.992469 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.992472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.992474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.992615 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:10.992886 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:10.992889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:10.992891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:10.993113 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:10.993224 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:10.993473 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 06:58:10.993644 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":719,"thread_start_us":604,"threads_started":1}
I20260812 06:58:10.994897 32094 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:58:10 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517890, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.188@KRBTEST.COM for oryx/127.18.70.188@KRBTEST.COM
I20260812 06:58:11.005641 32101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.995604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:38149 (local address 127.0.0.1:43808)
0812 06:58:10.995787 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:10.995802 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:10.995885 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:10.996101 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:10.996104 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:10.996416 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:10.996546 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.996553 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.997494 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.997498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.998364 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:10.998376 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.998964 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.998968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:10.999132 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:10.999589 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:10.999604 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:11.001330 (+ 1726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:11.003808 (+ 2478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.003812 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.003814 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.004154 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.004421 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.004424 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.004426 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.004561 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.004976 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:11.004979 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:11.005095 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 06:58:11.005196 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 06:58:11.005368 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 06:58:11.005692 32100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:10.995558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43808 (local address 127.18.70.188:38149)
0812 06:58:10.995696 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:10.995700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:10.995853 (+ 153us) server_negotiation.cc:407] Connection header received
0812 06:58:10.995950 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:10.995953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:10.996011 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:10.996079 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:10.996672 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.997398 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.998469 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:10.998852 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:10.998942 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.001501 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:11.001507 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:11.001511 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:11.001538 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:11.003696 (+ 2158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.004243 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.004246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.004248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.004348 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.004640 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.004643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.004645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.004887 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:11.004985 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.005274 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.005472 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":43}
I20260812 06:58:11.010027 32094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: Bootstrap starting.
I20260812 06:58:11.013077 32094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:11.014060 32094 log.cc:824] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:11.016638 32094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: No bootstrap required, opened a new log
I20260812 06:58:11.023824 32094 raft_consensus.cc:348] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } }
I20260812 06:58:11.024120 32094 raft_consensus.cc:374] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:11.024210 32094 raft_consensus.cc:729] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 650b2a15db3e447eb8f54de83b9aa779, State: Initialized, Role: FOLLOWER
I20260812 06:58:11.024694 32094 consensus_queue.cc:260] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } }
I20260812 06:58:11.025491 32106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } } }
I20260812 06:58:11.025800 32106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:58:11.026371 32094 sys_catalog.cc:564] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 06:58:11.034689 32125 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:58:11.034807 32125 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:58:11.034886 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 30831
I20260812 06:58:11.040162 31792 master_runner.cc:428] Detected that this master 650b2a15db3e447eb8f54de83b9aa779 is joining an existing cluster
I20260812 06:58:11.040263 31792 master_runner.cc:432] Initiating AddMaster RPC to add 127.18.70.188:38149
Aug 12 06:58:11 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.70.129@KRBTEST.COM
I20260812 06:58:11.067965 32131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.036213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34316 (local address 127.18.70.129:37567)
0812 06:58:11.036875 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.036884 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.036912 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:58:11.036981 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.036989 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.037239 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.037998 (+ 759us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:11.038871 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.041394 (+ 2523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.043288 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.044967 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.057149 (+ 12182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.057447 (+ 298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:11.057461 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:11.057478 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:11.057514 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:11.063333 (+ 5819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.064340 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.064350 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.064353 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.064531 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.065072 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.065076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.065079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.065551 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:11.067036 (+ 1485us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.067218 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.067502 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":328,"threads_started":1}
I20260812 06:58:11.069823 31067 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:11.072405 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.043837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55886 (local address 127.18.70.190:41895)
0812 06:58:11.044034 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.044040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.051545 (+ 7505us) server_negotiation.cc:407] Connection header received
0812 06:58:11.051719 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.051725 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.051815 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.051928 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:11.053446 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.054703 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.056838 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.057516 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.057610 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.065800 (+ 8190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:11.065808 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:11.065813 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:11.065853 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:11.069341 (+ 3488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.070155 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.070161 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.070164 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.070328 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.070795 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.070800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.070803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.071128 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:11.071252 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.071849 (+ 597us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.072081 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 06:58:11.073276 32146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.043967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:55886)
0812 06:58:11.051415 (+ 7448us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:11.051437 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:11.051597 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:11.052125 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:11.052131 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:11.052873 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:11.053260 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.053273 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.054925 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.054931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.056658 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.056673 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.057927 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.057934 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.058117 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.064142 (+ 6025us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:11.064163 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:11.065484 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:11.069529 (+ 4045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.069534 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.069537 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.070020 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.070475 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.070480 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.070484 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.070674 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.071334 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:11.071339 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:11.071541 (+ 202us) client_negotiation.cc:769] Sending connection context
0812 06:58:11.072575 (+ 1034us) client_negotiation.cc:240] Negotiation successful
0812 06:58:11.072863 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7288,"thread_start_us":7147,"threads_started":1}
I20260812 06:58:11.088814 32102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.044252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32942 (local address 127.18.70.189:44517)
0812 06:58:11.044466 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.044471 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.073597 (+ 29126us) server_negotiation.cc:407] Connection header received
0812 06:58:11.073867 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.073874 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.074017 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.074122 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:11.075333 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.076444 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.078591 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.079269 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.079367 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.081918 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:11.081925 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:11.081930 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:11.081976 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:11.085584 (+ 3608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.086468 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.086474 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.086478 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.086637 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.087137 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.087142 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.087146 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.087500 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:11.087628 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.088198 (+ 570us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.088435 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260812 06:58:11.090054 32146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.044193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:44517 (local address 127.0.0.1:32942)
0812 06:58:11.073495 (+ 29302us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:11.073523 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:11.073687 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:11.074313 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:11.074318 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:11.074874 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:11.075141 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.075153 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.076637 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.076642 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.078401 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.078417 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.079617 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.079624 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.079834 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.080434 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:11.080458 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:11.081670 (+ 1212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:11.085761 (+ 4091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.085766 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.085770 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.086332 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.086785 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.086790 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.086794 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.086980 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.087711 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:11.087716 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:11.087874 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 06:58:11.089338 (+ 1464us) client_negotiation.cc:240] Negotiation successful
0812 06:58:11.089658 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29198,"threads_started":1}
I20260812 06:58:11.106906 32100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.044557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43816 (local address 127.18.70.188:38149)
0812 06:58:11.044726 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.044732 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.074631 (+ 29899us) server_negotiation.cc:407] Connection header received
0812 06:58:11.074683 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.074687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.074753 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.074836 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:11.093788 (+ 18952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.094920 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.096764 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.097469 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.097554 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.100277 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:11.100283 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:11.100303 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:11.100336 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:11.103963 (+ 3627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.104725 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.104730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.104734 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.104895 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.105237 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.105241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.105245 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.105595 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:11.105743 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.106241 (+ 498us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.106472 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1677,"server-negotiator.queue_time_us":38}
I20260812 06:58:11.108177 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.045373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:38149 (local address 127.0.0.1:43816)
0812 06:58:11.074223 (+ 28850us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:11.074239 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:11.074349 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:11.092612 (+ 18263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:11.092621 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:11.093326 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:11.093634 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.093647 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.095122 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.095127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.096620 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.096635 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.098082 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.098091 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.098275 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.098893 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:11.098956 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:11.100101 (+ 1145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:11.104109 (+ 4008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.104114 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.104119 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.104613 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.105014 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.105019 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.105023 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.105147 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.105805 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:11.105810 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:11.105973 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 06:58:11.107373 (+ 1400us) client_negotiation.cc:240] Negotiation successful
0812 06:58:11.107679 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28719,"thread_start_us":29032,"threads_started":1}
I20260812 06:58:11.116669 32102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.064571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32958 (local address 127.18.70.189:44517)
0812 06:58:11.089292 (+ 24721us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.089298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.097013 (+ 7715us) server_negotiation.cc:407] Connection header received
0812 06:58:11.098630 (+ 1617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.098635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.098715 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.098790 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:11.099369 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.100407 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.114873 (+ 14466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.115735 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.115873 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.116098 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.116283 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.116410 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24616,"thread_start_us":46867,"threads_started":1}
I20260812 06:58:11.116699 32157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.064239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:44517 (local address 127.0.0.1:32958)
0812 06:58:11.096914 (+ 32675us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:11.096934 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:11.098469 (+ 1535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:11.098988 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:11.098992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:11.099018 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:11.099216 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.099227 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.100578 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.100583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.114698 (+ 14115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.114716 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.115920 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.115927 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.116110 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.116164 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 06:58:11.116247 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:58:11.116395 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32559,"threads_started":1}
I20260812 06:58:11.119028 31877 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260812 06:58:11.119684 31936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11de1582002747b0aee38b0a00cac210. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } } }
I20260812 06:58:11.119932 31936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: This master's current role is: LEARNER
Aug 12 06:58:11 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517888, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.190@KRBTEST.COM for oryx/127.18.70.188@KRBTEST.COM
I20260812 06:58:11.129699 32161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.079254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43822 (local address 127.18.70.188:38149)
0812 06:58:11.099113 (+ 19859us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.099118 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.112020 (+ 12902us) server_negotiation.cc:407] Connection header received
0812 06:58:11.112298 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.112305 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.112418 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.112532 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:11.117907 (+ 5375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.118931 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.120441 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.121089 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.121198 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.124199 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:11.124203 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:11.124206 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:11.124235 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:11.126986 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.127692 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.127697 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.127700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.127825 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.128220 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.128223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.128226 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.128523 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:11.128662 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.129081 (+ 419us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.129293 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19731,"thread_start_us":19877,"threads_started":1}
I20260812 06:58:11.129727 32151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.079165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:38149 (local address 127.0.0.1:43822)
0812 06:58:11.111914 (+ 32749us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:11.111933 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:11.112079 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:11.117129 (+ 5050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:11.117133 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:11.117512 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:11.117713 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.117721 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.119073 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.119077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.120301 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.120316 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.121267 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.121274 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.121424 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.121996 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:11.122014 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:11.123982 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:11.127109 (+ 3127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.127114 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.127119 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.127578 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.127963 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.127968 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.127972 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.128107 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.128632 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:11.128637 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:11.128815 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 06:58:11.128949 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 06:58:11.129282 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32624,"thread_start_us":17859,"threads_started":1}
I20260812 06:58:11.131263 30715 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.18.70.188:38149: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779"
member_type: NON_VOTER
last_known_addr {
host: "127.18.70.188"
port: 38149
}
attrs {
promote: true
}
}
dest_uuid: "11de1582002747b0aee38b0a00cac210"
cas_config_opid_index: 5
I20260812 06:58:11.132117 30715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } }
I20260812 06:58:11.134193 32150 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 650b2a15db3e447eb8f54de83b9aa779 (127.18.70.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:11.139052 32040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:11.143249 32040 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 FOLLOWER]: Refusing update from remote peer 11de1582002747b0aee38b0a00cac210: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 06:58:11.144137 32150 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.18.70.188:38149
I20260812 06:58:11.144758 31792 master.cc:537] Master@127.18.70.188:38149 shutting down...
I20260812 06:58:11.144665 32165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:11.145040 32165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:11.146157 31877 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 LEARNER]: Refusing update from remote peer 11de1582002747b0aee38b0a00cac210: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 06:58:11.147514 32150 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:11.148631 32150 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 06:58:11.159013 31877 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 650b2a15db3e447eb8f54de83b9aa779 (127.18.70.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:11.164532 31936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: NON_VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: true } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:11.164791 31936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: This master's current role is: LEARNER
W20260812 06:58:11.165760 30689 consensus_peers.cc:487] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 -> Peer 650b2a15db3e447eb8f54de83b9aa779 (127.18.70.188:38149): Couldn't send request to peer 650b2a15db3e447eb8f54de83b9aa779. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:58:11.166065 32165 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210: attempting to promote NON_VOTER 511926043ba14cb7a6a534d10fe668c4 to VOTER
I20260812 06:58:11.167084 32165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } }
I20260812 06:58:11.169108 31877 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 LEARNER]: Refusing update from remote peer 11de1582002747b0aee38b0a00cac210: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 06:58:11.169857 32165 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260812 06:58:11.170439 30689 consensus_peers.cc:487] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 -> Peer 650b2a15db3e447eb8f54de83b9aa779 (127.18.70.188:38149): Couldn't send request to peer 650b2a15db3e447eb8f54de83b9aa779. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:58:11.172070 32150 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 511926043ba14cb7a6a534d10fe668c4 (127.18.70.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:11.174940 32162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:11.175359 32162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:11.175545 32165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:11.175745 32165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:11.174612 31877 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 511926043ba14cb7a6a534d10fe668c4 (127.18.70.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:11.178613 31936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:11.178848 31936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:58:11.182220 32004 tablet.cc:2369] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:58:11.184360 31792 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:11.184715 31792 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:11.184921 31792 tablet_replica.cc:330] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: stopping tablet replica
I20260812 06:58:11.191151 31792 master.cc:552] Master@127.18.70.188:38149 shutdown complete.
I20260812 06:58:11.191224 31792 master_runner.cc:305] Clearing existing system tablet
I20260812 06:58:11.191550 31792 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:11.191640 31792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:11.194659 31792 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 06:58:11.195998 32177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:11.196367 31792 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:11.196760 31792 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:58:11.196882 31792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/wal
uuid: "650b2a15db3e447eb8f54de83b9aa779"
format_stamp: "Formatted at 2026-08-12 06:58:10 on dist-test-slave-tc2s"
server_key: "0ca9cf72a84aa6e610c82d3e8b40ba36"
server_key_iv: "baaa35e9091d3e5bf2e5df35781e078f"
server_key_version: "encryptionkey@0"
I20260812 06:58:11.200443 31792 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:11.205106 31792 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 06:58:11.205247 31792 log.cc:1196] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 06:58:11.205643 31792 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: Deleting consensus metadata
I20260812 06:58:11.205861 31792 master_runner.cc:315] Copying system tablet from 127.18.70.190:41895
I20260812 06:58:11.208231 31792 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: tablet copy: Beginning tablet copy session from remote peer at address 127.18.70.190:41895
I20260812 06:58:11.226650 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.208973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55892 (local address 127.18.70.190:41895)
0812 06:58:11.209211 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.209218 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.214512 (+ 5294us) server_negotiation.cc:407] Connection header received
0812 06:58:11.214687 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.214693 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.214767 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.214850 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:11.215649 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.216407 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.217611 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.218080 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.218191 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.219963 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:11.219968 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:11.219971 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:11.220001 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:11.223448 (+ 3447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.224258 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.224264 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.224268 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.224433 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.224867 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.224872 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.224875 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.225263 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:11.225388 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.225978 (+ 590us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.226197 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260812 06:58:11.227963 32187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.208884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:55892)
0812 06:58:11.214392 (+ 5508us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:11.214411 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:11.214566 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:11.214899 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:11.214904 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:11.215295 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:11.215499 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.215510 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.216556 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.216560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.217474 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.217486 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.218228 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.218234 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.218418 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.219005 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:11.219022 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:11.219757 (+ 735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:11.223604 (+ 3847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.223610 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.223614 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.224119 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.224579 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.224583 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.224587 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.224750 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.225483 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:11.225488 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:11.225684 (+ 196us) client_negotiation.cc:769] Sending connection context
0812 06:58:11.227080 (+ 1396us) client_negotiation.cc:240] Negotiation successful
0812 06:58:11.227461 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5354,"thread_start_us":5233,"threads_started":1}
I20260812 06:58:11.228798 30751 tablet_copy_service.cc:140] P 11de1582002747b0aee38b0a00cac210: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 650b2a15db3e447eb8f54de83b9aa779 ({username='oryx', principal='oryx/127.18.70.188@KRBTEST.COM'} at 127.0.0.1:55892)
I20260812 06:58:11.228965 30751 tablet_copy_service.cc:161] P 11de1582002747b0aee38b0a00cac210: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 650b2a15db3e447eb8f54de83b9aa779 at {username='oryx', principal='oryx/127.18.70.188@KRBTEST.COM'} at 127.0.0.1:55892: session id = 650b2a15db3e447eb8f54de83b9aa779-00000000000000000000000000000000
I20260812 06:58:11.232712 30751 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:58:11.234549 31792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 06:58:11.241334 31792 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: tablet copy: Starting download of 0 data blocks...
I20260812 06:58:11.241624 31792 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: tablet copy: Starting download of 1 WAL segments...
I20260812 06:58:11.244205 31792 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:58:11.247478 30751 tablet_copy_service.cc:342] P 11de1582002747b0aee38b0a00cac210: Request end of tablet copy session 650b2a15db3e447eb8f54de83b9aa779-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.18.70.188@KRBTEST.COM'} at 127.0.0.1:55892
I20260812 06:58:11.247593 30751 tablet_copy_service.cc:433] P 11de1582002747b0aee38b0a00cac210: ending tablet copy session 650b2a15db3e447eb8f54de83b9aa779-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 650b2a15db3e447eb8f54de83b9aa779
I20260812 06:58:11.250831 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 30831
I20260812 06:58:11.266093 31792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:11.274024 32189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:11.279980 32188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:11.290359 31792 server_base.cc:1034] running on GCE node
W20260812 06:58:11.291347 32193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:11.291785 31792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:11.292403 31792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:11.293607 31792 hybrid_clock.cc:648] HybridClock initialized: now 1786517891293541 us; error 48 us; skew 500 ppm
I20260812 06:58:11.293862 31792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:58:11.294188 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:37567
--local_ip_for_outbound_sockets=127.18.70.129
--tserver_master_addrs=127.18.70.190:41895
--webserver_port=33805
--webserver_interface=127.18.70.129
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab
--principal=oryx/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.70.190:41895,127.18.70.189:44517
--tserver_master_addrs=127.18.70.190:41895,127.18.70.189:44517,127.18.70.188:38149 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:58:11 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517891, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:11.296198 31792 init.cc:377] Logged in from keytab as oryx/127.18.70.188@KRBTEST.COM (short username oryx)
I20260812 06:58:11.297592 31792 webserver.cc:460] Webserver started at http://127.18.70.188:38663/ using document root <none> and password file <none>
I20260812 06:58:11.297992 31792 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:11.298153 31792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:11.301160 31792 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 06:58:11.303014 32202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:11.303476 31792 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:58:11.303603 31792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/wal
uuid: "650b2a15db3e447eb8f54de83b9aa779"
format_stamp: "Formatted at 2026-08-12 06:58:10 on dist-test-slave-tc2s"
server_key: "0ca9cf72a84aa6e610c82d3e8b40ba36"
server_key_iv: "baaa35e9091d3e5bf2e5df35781e078f"
server_key_version: "encryptionkey@0"
I20260812 06:58:11.303795 31792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:11.336072 31792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:11.340158 31792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:11.361656 31792 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.188:38149
I20260812 06:58:11.361704 32301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.188:38149 every 8 connection(s)
I20260812 06:58:11.362761 31792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
I20260812 06:58:11.368875 32302 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:58:11.372709 32302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: Bootstrap starting.
I20260812 06:58:11.391280 32302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:58:11.391793 32302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: Bootstrap complete.
I20260812 06:58:11.392874 32302 raft_consensus.cc:348] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } }
I20260812 06:58:11.393179 32302 raft_consensus.cc:729] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 650b2a15db3e447eb8f54de83b9aa779, State: Initialized, Role: LEARNER
I20260812 06:58:11.393452 32302 consensus_queue.cc:260] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } }
I20260812 06:58:11.394384 32307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:11.394677 32302 sys_catalog.cc:564] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:58:11.394891 32307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: This master's current role is: LEARNER
I20260812 06:58:11.425685 32323 catalog_manager.cc:1259] Loaded cluster ID: bcbaf79111ab42b08ea3692545479e35
I20260812 06:58:11.425784 32323 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: loading cluster ID for follower catalog manager: success
I20260812 06:58:11.428259 32323 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: acquiring CA information for follower catalog manager: success
I20260812 06:58:11.430141 32323 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 06:58:11.690582 32203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:11.690858 32203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:11.690963 32203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:11.698264 32203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:11.698376 32203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:11.698495 32203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:58:11.708585 32203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab
--principal=oryx/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:37567
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=33805
--tserver_master_addrs=127.18.70.190:41895,127.18.70.189:44517,127.18.70.188:38149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:11.709867 32203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:11.711244 32203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:11.723825 32337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:11.723793 32339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:11.723866 32348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:11.724643 32203 server_base.cc:1034] running on GCE node
I20260812 06:58:11.725239 32203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:11.726158 32203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:11.727351 32203 hybrid_clock.cc:648] HybridClock initialized: now 1786517891727307 us; error 38 us; skew 500 ppm
I20260812 06:58:11.727641 32203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:11 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517891, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:11.730602 32203 init.cc:377] Logged in from keytab as oryx/127.18.70.129@KRBTEST.COM (short username oryx)
I20260812 06:58:11.731958 32203 webserver.cc:460] Webserver started at http://127.18.70.129:33805/ using document root <none> and password file <none>
I20260812 06:58:11.732621 32203 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:11.732753 32203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:11.737831 32203 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 06:58:11.740471 32360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:11.741688 32203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 06:58:11.741814 32203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "0e2ba71074d645408b63648bfafd122c"
format_stamp: "Formatted at 2026-08-12 06:58:08 on dist-test-slave-tc2s"
server_key: "a82bd762bf3c0efacb4e416759c671fe"
server_key_iv: "beb7023d5cc140d8c9189ac2929cdf65"
server_key_version: "encryptionkey@0"
I20260812 06:58:11.742772 32203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:11.757867 32203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:11.761736 32203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:11.762104 32203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:11.763284 32203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:11.764950 32203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:11.765050 32203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:11.765151 32203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:11.765228 32203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:11.768478 32368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.761576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:38149 (local address 127.0.0.1:43838)
0812 06:58:11.762164 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:11.762217 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:11.762352 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:11.762841 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:11.762844 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:11.762867 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:11.763072 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.763085 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.764852 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.764857 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.766340 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.766355 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.767902 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.767907 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.768042 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.768068 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 06:58:11.768129 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:58:11.768228 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":311,"threads_started":1}
I20260812 06:58:11.768625 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.761656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43838 (local address 127.18.70.188:38149)
0812 06:58:11.762467 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.762474 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.762494 (+ 20us) server_negotiation.cc:407] Connection header received
0812 06:58:11.762582 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.762587 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.762694 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.762831 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:11.763230 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.764717 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.766527 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.767732 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.767869 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.768099 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.768157 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.768286 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":528,"threads_started":1}
I20260812 06:58:11.769595 32257 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 06:58:11.770391 32307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11de1582002747b0aee38b0a00cac210. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:11.770713 32307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: This master's current role is: LEARNER
I20260812 06:58:11.798058 32203 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:37567
I20260812 06:58:11.798120 32550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:37567 every 8 connection(s)
I20260812 06:58:11.799557 32203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:58:11.803892 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 32203
I20260812 06:58:11.804255 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 31092
Aug 12 06:58:11 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.70.130@KRBTEST.COM
Aug 12 06:58:11 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517891, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.188@KRBTEST.COM
Aug 12 06:58:11 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517891, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.189@KRBTEST.COM
Aug 12 06:58:11 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517891, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:11.838021 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.802908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:48233 (local address 127.18.70.188:38149)
0812 06:58:11.803582 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.803589 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.815435 (+ 11846us) server_negotiation.cc:407] Connection header received
0812 06:58:11.818811 (+ 3376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.818817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.818893 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.818965 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:11.821276 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.822404 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.825253 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.825868 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.825991 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.831118 (+ 5127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:11.831124 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:11.831129 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:11.831169 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:11.834321 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.835221 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.835227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.835230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.835382 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.835901 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.835906 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.835909 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.836268 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:11.836391 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.837384 (+ 993us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.837632 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502}
I20260812 06:58:11.839044 32564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.803200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:52395 (local address 127.18.70.189:44517)
0812 06:58:11.803678 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.803684 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.818553 (+ 14869us) server_negotiation.cc:407] Connection header received
0812 06:58:11.818796 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.818801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.818894 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.818968 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:11.821275 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.822404 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.825253 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.825868 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.825991 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.832395 (+ 6404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:11.832401 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:11.832405 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:11.832446 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:11.835721 (+ 3275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.836604 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.836609 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.836612 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.836745 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.837207 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.837212 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.837215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.837556 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:11.837666 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.838481 (+ 815us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.838689 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":456,"threads_started":1}
I20260812 06:58:11.839212 32561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.802526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:40975 (local address 127.18.70.190:41895)
0812 06:58:11.810284 (+ 7758us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.810288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.816106 (+ 5818us) server_negotiation.cc:407] Connection header received
0812 06:58:11.818347 (+ 2241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.818353 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.818437 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.818564 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:11.821284 (+ 2720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.822431 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.825270 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.825946 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.826048 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.831847 (+ 5799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:11.831854 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:11.831858 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:11.831899 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:11.835866 (+ 3967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.836798 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.836803 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.836806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.837076 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.837541 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.837546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.837549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.837935 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:11.838059 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.838637 (+ 578us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.838859 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7639,"thread_start_us":7536,"threads_started":1}
I20260812 06:58:11.839213 32573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.805686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36820 (local address 127.18.70.130:38021)
0812 06:58:11.817315 (+ 11629us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:11.817323 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:11.817352 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:58:11.817422 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:11.817429 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:11.817685 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:11.817846 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:11.819944 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.821498 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.823322 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.824154 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.824272 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.830790 (+ 6518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:11.830805 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:11.830822 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:11.830874 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:11.834843 (+ 3969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.835730 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.835739 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.835743 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.835899 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:11.836346 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:11.836351 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:11.836354 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:11.836784 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:11.837093 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:11.838425 (+ 1332us) server_negotiation.cc:299] Negotiation successful
0812 06:58:11.838696 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11456,"thread_start_us":11269,"threads_started":1}
I20260812 06:58:11.840263 32567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.803117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:38149 (local address 127.18.70.129:48233)
0812 06:58:11.815274 (+ 12157us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:11.815314 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:11.817803 (+ 2489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:11.819192 (+ 1389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:11.819197 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:11.820015 (+ 818us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:11.821063 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.821090 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.822612 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.822617 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.825087 (+ 2470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.825103 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.826371 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.826379 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.826817 (+ 438us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.827718 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:11.827745 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:11.830867 (+ 3122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:11.834477 (+ 3610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.834487 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.834514 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.835080 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.835545 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.835550 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.835554 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.835781 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.836513 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:11.836521 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:11.836957 (+ 436us) client_negotiation.cc:769] Sending connection context
0812 06:58:11.838283 (+ 1326us) client_negotiation.cc:240] Negotiation successful
0812 06:58:11.838806 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11886,"mutex_wait_us":383,"spinlock_wait_cycles":27392,"thread_start_us":12612,"threads_started":1}
I20260812 06:58:11.840305 32565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.803679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.129:40975)
0812 06:58:11.815919 (+ 12240us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:11.815936 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:11.818078 (+ 2142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:11.818846 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:11.818859 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:11.820014 (+ 1155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:11.821064 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.821092 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.822661 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.822666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.825103 (+ 2437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.825117 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.826418 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.826427 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.826822 (+ 395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.827532 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:11.827571 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:11.831623 (+ 4052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:11.836033 (+ 4410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.836037 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.836040 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.836659 (+ 619us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.837233 (+ 574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.837237 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.837241 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.837397 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.838163 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:11.838168 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:11.838322 (+ 154us) client_negotiation.cc:769] Sending connection context
0812 06:58:11.839484 (+ 1162us) client_negotiation.cc:240] Negotiation successful
0812 06:58:11.839755 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12113,"mutex_wait_us":472,"spinlock_wait_cycles":26240,"thread_start_us":11259,"threads_started":1}
I20260812 06:58:11.841130 31311 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:11.841854 32555 heartbeater.cc:347] Connected to a master server at 127.18.70.190:41895
I20260812 06:58:11.841881 32551 heartbeater.cc:347] Connected to a master server at 127.18.70.188:38149
I20260812 06:58:11.842283 32551 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:11.842286 32555 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:11.843199 32555 heartbeater.cc:511] Master 127.18.70.190:41895 requested a full tablet report, sending...
I20260812 06:58:11.844485 32551 heartbeater.cc:511] Master 127.18.70.188:38149 requested a full tablet report, sending...
I20260812 06:58:11.845180 30715 ts_manager.cc:194] Re-registered known tserver with Master: 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567)
I20260812 06:58:11.846237 30715 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:40975
I20260812 06:58:11.846406 32239 ts_manager.cc:194] Registered new tserver with Master: 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567)
I20260812 06:58:11.847682 32576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:11.807275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:44517 (local address 127.18.70.129:52395)
0812 06:58:11.818452 (+ 11177us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:11.818475 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:11.818650 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:11.819224 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:11.819228 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:11.820015 (+ 787us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:11.821063 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.821090 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.822611 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.822617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.825103 (+ 2486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:11.825113 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:11.826371 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:11.826379 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:11.826827 (+ 448us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:11.827799 (+ 972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:11.827821 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:11.832159 (+ 4338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:11.835867 (+ 3708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.835871 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.835875 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.836483 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.836884 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:11.836892 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:11.836896 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:11.837077 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:11.837757 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:11.837762 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:11.837940 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 06:58:11.846969 (+ 9029us) client_negotiation.cc:240] Negotiation successful
0812 06:58:11.847287 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11058,"mutex_wait_us":552,"thread_start_us":10933,"threads_started":1}
I20260812 06:58:11.848670 32557 heartbeater.cc:347] Connected to a master server at 127.18.70.189:44517
I20260812 06:58:11.848814 32557 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:11.849239 32557 heartbeater.cc:511] Master 127.18.70.189:44517 requested a full tablet report, sending...
I20260812 06:58:11.850657 31862 ts_manager.cc:194] Registered new tserver with Master: 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567)
I20260812 06:58:11.927088 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 31092
I20260812 06:58:11.949927 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:38021
--local_ip_for_outbound_sockets=127.18.70.130
--tserver_master_addrs=127.18.70.190:41895
--webserver_port=43151
--webserver_interface=127.18.70.130
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab
--principal=oryx/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.70.190:41895,127.18.70.189:44517
--tserver_master_addrs=127.18.70.190:41895,127.18.70.189:44517,127.18.70.188:38149 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:12.280071 32579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:12.280351 32579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:12.280459 32579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:12.287889 32579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:12.288017 32579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:12.288197 32579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:58:12.288654 32591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: NON_VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: true } } }
I20260812 06:58:12.288961 32591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:12.290165 32593 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210: attempting to promote NON_VOTER 650b2a15db3e447eb8f54de83b9aa779 to VOTER
I20260812 06:58:12.290910 32593 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } }
I20260812 06:58:12.293226 31877 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 FOLLOWER]: Refusing update from remote peer 11de1582002747b0aee38b0a00cac210: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 06:58:12.293414 32257 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 LEARNER]: Refusing update from remote peer 11de1582002747b0aee38b0a00cac210: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 06:58:12.293980 32592 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 06:58:12.294423 32591 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 06:58:12.297230 32591 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 650b2a15db3e447eb8f54de83b9aa779 (127.18.70.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:12.297854 31877 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 650b2a15db3e447eb8f54de83b9aa779 (127.18.70.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:12.301674 32593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:12.301946 32593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:12.302214 32593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:12.302443 32593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:12.302554 32579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab
--principal=oryx/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:38021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=43151
--tserver_master_addrs=127.18.70.190:41895,127.18.70.189:44517,127.18.70.188:38149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:12.304383 32579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:12.305749 32593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:12.305939 32593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:12.306315 32579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:58:12.306702 32257 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 650b2a15db3e447eb8f54de83b9aa779 (127.18.70.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:12.310043 32602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:12.310420 32602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:58:12.310433 32601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "11de1582002747b0aee38b0a00cac210" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:12.310808 32601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:58:12.320204 32605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:12.321175 32579 server_base.cc:1034] running on GCE node
W20260812 06:58:12.322114 32611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:12.322131 32608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:12.322877 32579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:12.323765 32579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:12.324975 32579 hybrid_clock.cc:648] HybridClock initialized: now 1786517892324916 us; error 33 us; skew 500 ppm
I20260812 06:58:12.325265 32579 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:12 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517892, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:12.328341 32579 init.cc:377] Logged in from keytab as oryx/127.18.70.130@KRBTEST.COM (short username oryx)
I20260812 06:58:12.329661 32579 webserver.cc:460] Webserver started at http://127.18.70.130:43151/ using document root <none> and password file <none>
I20260812 06:58:12.330320 32579 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:12.330451 32579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:12.335518 32579 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 06:58:12.338124 32624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:12.339519 32579 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:58:12.339664 32579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "258730b2e0564b759cb81826c6cb54c0"
format_stamp: "Formatted at 2026-08-12 06:58:09 on dist-test-slave-tc2s"
server_key: "0c1b19dbc6dc867153c7878f1f1b0190"
server_key_iv: "1b0e296ef0aff58e4cde0d5730a5568e"
server_key_version: "encryptionkey@0"
I20260812 06:58:12.340643 32579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:12.363649 32579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:12.367902 32579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:12.368158 32579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:12.369113 32579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:12.370663 32579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:12.370764 32579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:12.370864 32579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:12.370949 32579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:12.400117 32579 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:38021
I20260812 06:58:12.400182 383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:38021 every 8 connection(s)
I20260812 06:58:12.401530 32579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:58:12.410413 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 32579
I20260812 06:58:12.410732 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 31327
Aug 12 06:58:12 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517892, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.189@KRBTEST.COM
Aug 12 06:58:12 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517892, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
Aug 12 06:58:12 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517892, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.188@KRBTEST.COM
I20260812 06:58:12.440120 396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:12.404420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:44091 (local address 127.18.70.189:44517)
0812 06:58:12.404839 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:12.404846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:12.418121 (+ 13275us) server_negotiation.cc:407] Connection header received
0812 06:58:12.418382 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:12.418388 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:12.418486 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:12.418568 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:12.421346 (+ 2778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.422519 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.424650 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.425380 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.425478 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:12.430376 (+ 4898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:12.430383 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:12.430388 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:12.430442 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:12.433757 (+ 3315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:12.435756 (+ 1999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:12.435762 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:12.435766 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:12.435933 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:12.436546 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:12.436551 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:12.436554 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:12.436927 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:12.437087 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:12.439513 (+ 2426us) server_negotiation.cc:299] Negotiation successful
0812 06:58:12.439737 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":409,"threads_started":1}
Aug 12 06:58:12 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.70.131@KRBTEST.COM
I20260812 06:58:12.442677 403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:12.405087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:44517 (local address 127.18.70.130:44091)
0812 06:58:12.418013 (+ 12926us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:12.418032 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:12.418229 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:12.418787 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:12.418791 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:12.419409 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:12.419717 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:12.419726 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.422724 (+ 2998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.422729 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:12.424470 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:12.424488 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.425840 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.425847 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:12.426207 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:12.427068 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:12.427101 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:12.430138 (+ 3037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:12.433928 (+ 3790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:12.433937 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:12.433952 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:12.435620 (+ 1668us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:12.436116 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:12.436120 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:12.436124 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:12.436404 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:12.437856 (+ 1452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:12.437865 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:12.439023 (+ 1158us) client_negotiation.cc:769] Sending connection context
0812 06:58:12.440678 (+ 1655us) client_negotiation.cc:240] Negotiation successful
0812 06:58:12.441246 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12751,"mutex_wait_us":59,"spinlock_wait_cycles":66816,"thread_start_us":12440,"threads_started":1}
I20260812 06:58:12.444401 393 heartbeater.cc:347] Connected to a master server at 127.18.70.189:44517
I20260812 06:58:12.444752 393 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:12.445829 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:12.404721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:38971 (local address 127.18.70.190:41895)
0812 06:58:12.416993 (+ 12272us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:12.417000 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:12.417025 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:58:12.417103 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:12.417110 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:12.417201 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:12.417325 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:12.419885 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.421137 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.434011 (+ 12874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.434635 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.434775 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:12.438547 (+ 3772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:12.438553 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:12.438558 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:12.438610 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:12.442537 (+ 3927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:12.443549 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:12.443554 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:12.443558 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:12.443687 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:12.444142 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:12.444148 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:12.444151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:12.444535 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:12.444682 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:12.445233 (+ 551us) server_negotiation.cc:299] Negotiation successful
0812 06:58:12.445473 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12125,"thread_start_us":12714,"threads_started":1}
I20260812 06:58:12.445829 393 heartbeater.cc:511] Master 127.18.70.189:44517 requested a full tablet report, sending...
I20260812 06:58:12.445886 398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:12.405087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.130:38971)
0812 06:58:12.406098 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:12.406164 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:12.408875 (+ 2711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:12.417853 (+ 8978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:12.417865 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:12.418714 (+ 849us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:12.419661 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:12.419690 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.422207 (+ 2517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.422213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:12.432159 (+ 9946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:12.432175 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.434841 (+ 2666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.434848 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:12.435081 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:12.435674 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:12.435697 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:12.438347 (+ 2650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:12.442800 (+ 4453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:12.442804 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:12.442807 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:12.443437 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:12.443793 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:12.443797 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:12.443800 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:12.444031 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:12.444667 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:12.444672 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:12.444823 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 06:58:12.444982 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 06:58:12.445284 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"mutex_wait_us":7037,"spinlock_wait_cycles":4992,"thread_start_us":3228,"threads_started":1}
I20260812 06:58:12.447948 31862 ts_manager.cc:194] Registered new tserver with Master: 258730b2e0564b759cb81826c6cb54c0 (127.18.70.130:38021)
I20260812 06:58:12.448144 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:12.405974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:38149 (local address 127.18.70.130:43215)
0812 06:58:12.430714 (+ 24740us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:12.430731 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:12.430900 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:12.431434 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:12.431439 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:12.431973 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:12.432336 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:12.432350 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.433883 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.433912 (+ 29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:12.435087 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:12.435101 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.436264 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.436271 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:12.436488 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:12.436981 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:12.437003 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:12.439098 (+ 2095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:12.442793 (+ 3695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:12.442797 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:12.442801 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:12.443436 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:12.444824 (+ 1388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:12.444829 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:12.444833 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:12.445008 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:12.447174 (+ 2166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:12.447179 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:12.447326 (+ 147us) client_negotiation.cc:769] Sending connection context
0812 06:58:12.447467 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 06:58:12.447719 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24625,"mutex_wait_us":33,"spinlock_wait_cycles":32640,"thread_start_us":24744,"threads_started":1}
I20260812 06:58:12.448321 391 heartbeater.cc:347] Connected to a master server at 127.18.70.190:41895
I20260812 06:58:12.448542 391 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:12.449113 391 heartbeater.cc:511] Master 127.18.70.190:41895 requested a full tablet report, sending...
I20260812 06:58:12.449520 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:12.406530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:43215 (local address 127.18.70.188:38149)
0812 06:58:12.430336 (+ 23806us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:12.430341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:12.430985 (+ 644us) server_negotiation.cc:407] Connection header received
0812 06:58:12.431054 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:12.431058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:12.431123 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:12.431226 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:12.432531 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.433725 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.435267 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.435870 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.435996 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:12.439362 (+ 3366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:12.439369 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:12.439374 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:12.439417 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:12.442668 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:12.443873 (+ 1205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:12.443878 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:12.443881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:12.444039 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:12.446612 (+ 2573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:12.446617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:12.446620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:12.446971 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:12.447111 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:12.448753 (+ 1642us) server_negotiation.cc:299] Negotiation successful
0812 06:58:12.449132 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23663,"thread_start_us":23503,"threads_started":1}
I20260812 06:58:12.449839 408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:12.411810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51448 (local address 127.18.70.131:35691)
0812 06:58:12.428367 (+ 16557us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:12.428375 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:12.428953 (+ 578us) server_negotiation.cc:407] Connection header received
0812 06:58:12.429098 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:12.429107 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:12.429357 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:12.429537 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:12.431556 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.432870 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.434191 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:12.435150 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:12.435277 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:12.441862 (+ 6585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:12.441876 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:12.441929 (+ 53us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:12.441971 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:12.446233 (+ 4262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:12.447024 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:12.447032 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:12.447035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:12.447206 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:12.447687 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:12.447692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:12.447695 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:12.448026 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:12.448313 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:12.449208 (+ 895us) server_negotiation.cc:299] Negotiation successful
0812 06:58:12.449467 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16361,"thread_start_us":17249,"threads_started":1}
I20260812 06:58:12.450157 30715 ts_manager.cc:194] Re-registered known tserver with Master: 258730b2e0564b759cb81826c6cb54c0 (127.18.70.130:38021)
I20260812 06:58:12.450595 387 heartbeater.cc:347] Connected to a master server at 127.18.70.188:38149
I20260812 06:58:12.450726 387 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:12.451086 387 heartbeater.cc:511] Master 127.18.70.188:38149 requested a full tablet report, sending...
I20260812 06:58:12.451251 30715 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:38971
I20260812 06:58:12.452229 32239 ts_manager.cc:194] Registered new tserver with Master: 258730b2e0564b759cb81826c6cb54c0 (127.18.70.130:38021)
I20260812 06:58:12.452803 31569 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:12.535944 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 31327
I20260812 06:58:12.559769 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:35691
--local_ip_for_outbound_sockets=127.18.70.131
--tserver_master_addrs=127.18.70.190:41895
--webserver_port=41899
--webserver_interface=127.18.70.131
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab
--principal=oryx/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.70.190:41895,127.18.70.189:44517
--tserver_master_addrs=127.18.70.190:41895,127.18.70.189:44517,127.18.70.188:38149 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:58:12.849351 32555 heartbeater.cc:503] Master 127.18.70.190:41895 was elected leader, sending a full tablet report...
W20260812 06:58:12.883858 413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:12.884189 413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:12.884338 413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:12.891562 413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:12.891670 413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:12.891820 413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:58:12.901405 413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab
--principal=oryx/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:35691
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=41899
--tserver_master_addrs=127.18.70.190:41895,127.18.70.189:44517,127.18.70.188:38149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:12.902683 413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:12.904212 413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:12.917109 431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:12.917181 424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:12.917157 425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:12.917853 413 server_base.cc:1034] running on GCE node
I20260812 06:58:12.918484 413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:12.919353 413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:12.920531 413 hybrid_clock.cc:648] HybridClock initialized: now 1786517892920480 us; error 42 us; skew 500 ppm
I20260812 06:58:12.920820 413 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:12 dist-test-slave-tc2s krb5kdc[30621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517892, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:12.923795 413 init.cc:377] Logged in from keytab as oryx/127.18.70.131@KRBTEST.COM (short username oryx)
I20260812 06:58:12.925091 413 webserver.cc:460] Webserver started at http://127.18.70.131:41899/ using document root <none> and password file <none>
I20260812 06:58:12.925719 413 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:12.925850 413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:12.931808 413 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 06:58:12.935285 444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:12.936743 413 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 06:58:12.936916 413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "aee6353114354080b7ebeb966697632d"
format_stamp: "Formatted at 2026-08-12 06:58:09 on dist-test-slave-tc2s"
server_key: "65ed2221edfecf856c2c990e75b9b28f"
server_key_iv: "1ec04752ae8f0a3ca37b391f4a898aa4"
server_key_version: "encryptionkey@0"
I20260812 06:58:12.937961 413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:12.966709 413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:12.970961 413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:12.971228 413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:12.972254 413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:12.973825 413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:12.973951 413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260812 06:58:12.974068 413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:12.974160 413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:13.007359 413 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:35691
I20260812 06:58:13.007431 660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:35691 every 8 connection(s)
I20260812 06:58:13.008731 413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:58:13.011544 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 413
Aug 12 06:58:13 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517892, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.188@KRBTEST.COM
Aug 12 06:58:13 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517892, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:13.072856 674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.012801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:38187 (local address 127.18.70.188:38149)
0812 06:58:13.038945 (+ 26144us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.038954 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.038985 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:58:13.039098 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.039106 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.039241 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.042717 (+ 3476us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:13.042991 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.046333 (+ 3342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.049864 (+ 3531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.050613 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.054118 (+ 3505us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.056226 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:13.056234 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:13.056240 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:13.056291 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:13.061864 (+ 5573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.067015 (+ 5151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.067021 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.067025 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.067280 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.068770 (+ 1490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.068776 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.068780 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.069251 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:13.071915 (+ 2664us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.072103 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.072392 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25980,"thread_start_us":25860,"threads_started":1}
I20260812 06:58:13.073020 682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.012876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.131:55981)
0812 06:58:13.033852 (+ 20976us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:13.033972 (+ 120us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:13.037306 (+ 3334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:13.044497 (+ 7191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:13.044503 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:13.044932 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:13.045328 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.045345 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.047332 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.047340 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.052670 (+ 5330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.052688 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.058521 (+ 5833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.058534 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.058829 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.059593 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:13.059621 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:13.063360 (+ 3739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:13.068095 (+ 4735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:13.068100 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:13.068104 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:13.068621 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:13.069075 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:13.069081 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:13.069084 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:13.069273 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:13.070042 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:13.070048 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:13.070215 (+ 167us) client_negotiation.cc:769] Sending connection context
0812 06:58:13.070555 (+ 340us) client_negotiation.cc:240] Negotiation successful
0812 06:58:13.071498 (+ 943us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20492,"mutex_wait_us":3721,"thread_start_us":30770,"threads_started":1}
Aug 12 06:58:13 dist-test-slave-tc2s krb5kdc[30621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517892, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.189@KRBTEST.COM
I20260812 06:58:13.075124 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.013483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:38149 (local address 127.18.70.131:38187)
0812 06:58:13.035766 (+ 22283us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:13.035790 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:13.037750 (+ 1960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:13.039821 (+ 2071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:13.039840 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:13.041206 (+ 1366us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:13.042453 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.042486 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.046541 (+ 4055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.046548 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.049063 (+ 2515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.049079 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.050906 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.050913 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.051245 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.052255 (+ 1010us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:13.052291 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:13.055894 (+ 3603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:13.065908 (+ 10014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:13.065922 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:13.065950 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:13.066809 (+ 859us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:13.067846 (+ 1037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:13.067852 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:13.067857 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:13.068254 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:13.069429 (+ 1175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:13.069440 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:13.070108 (+ 668us) client_negotiation.cc:769] Sending connection context
0812 06:58:13.070554 (+ 446us) client_negotiation.cc:240] Negotiation successful
0812 06:58:13.071333 (+ 779us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22115,"mutex_wait_us":5,"spinlock_wait_cycles":45440,"thread_start_us":21906,"threads_started":1}
I20260812 06:58:13.076537 670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.012422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:55981 (local address 127.18.70.190:41895)
0812 06:58:13.043721 (+ 31299us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.043729 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.043754 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:58:13.043839 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.043846 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.043943 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.045200 (+ 1257us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:13.045591 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.047097 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.054811 (+ 7714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.058090 (+ 3279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.058229 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.063831 (+ 5602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:13.063839 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:13.063844 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:13.063898 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:13.067918 (+ 4020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.068770 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.068774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.068777 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.068948 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.069424 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.069428 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.069431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.069861 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:13.071194 (+ 1333us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.075913 (+ 4719us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.076176 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31149,"thread_start_us":31024,"threads_started":1}
I20260812 06:58:13.076923 661 heartbeater.cc:347] Connected to a master server at 127.18.70.188:38149
I20260812 06:58:13.077284 661 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:13.077595 663 heartbeater.cc:347] Connected to a master server at 127.18.70.190:41895
I20260812 06:58:13.077809 663 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:13.078374 661 heartbeater.cc:511] Master 127.18.70.188:38149 requested a full tablet report, sending...
I20260812 06:58:13.078538 663 heartbeater.cc:511] Master 127.18.70.190:41895 requested a full tablet report, sending...
I20260812 06:58:13.082120 30715 ts_manager.cc:194] Re-registered known tserver with Master: aee6353114354080b7ebeb966697632d (127.18.70.131:35691)
I20260812 06:58:13.082823 32239 ts_manager.cc:194] Registered new tserver with Master: aee6353114354080b7ebeb966697632d (127.18.70.131:35691)
I20260812 06:58:13.083233 30715 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:55981
I20260812 06:58:13.088933 679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.017503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:60901 (local address 127.18.70.189:44517)
0812 06:58:13.032913 (+ 15410us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.032922 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.044300 (+ 11378us) server_negotiation.cc:407] Connection header received
0812 06:58:13.044609 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.044616 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.044719 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.044858 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:13.062574 (+ 17716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.063733 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.066047 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.066754 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.066858 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.075903 (+ 9045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:13.075910 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:13.075914 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:13.075962 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:13.085553 (+ 9591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.086420 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.086425 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.086428 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.086614 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.087100 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.087106 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.087109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.087506 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:13.087658 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.088234 (+ 576us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.088489 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15215,"thread_start_us":15439,"threads_started":1}
I20260812 06:58:13.090054 675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.017584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:44517 (local address 127.18.70.131:60901)
0812 06:58:13.044156 (+ 26572us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:13.044180 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:13.044424 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:13.044907 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:13.044913 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:13.045651 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:13.061664 (+ 16013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.061690 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.064049 (+ 2359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.064054 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.065829 (+ 1775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.065846 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.067203 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.067209 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.067392 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.069258 (+ 1866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:13.069280 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:13.075512 (+ 6232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:13.085728 (+ 10216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:13.085733 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:13.085737 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:13.086302 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:13.086768 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:13.086774 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:13.086778 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:13.086965 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:13.087758 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:13.087764 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:13.087941 (+ 177us) client_negotiation.cc:769] Sending connection context
0812 06:58:13.089237 (+ 1296us) client_negotiation.cc:240] Negotiation successful
0812 06:58:13.089602 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26342,"thread_start_us":16365,"threads_started":1}
I20260812 06:58:13.091077 664 heartbeater.cc:347] Connected to a master server at 127.18.70.189:44517
I20260812 06:58:13.091234 664 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:13.091635 664 heartbeater.cc:511] Master 127.18.70.189:44517 requested a full tablet report, sending...
I20260812 06:58:13.092965 31862 ts_manager.cc:194] Registered new tserver with Master: aee6353114354080b7ebeb966697632d (127.18.70.131:35691)
I20260812 06:58:13.097165 694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.049836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37718 (local address 127.18.70.189:44517)
0812 06:58:13.063924 (+ 14088us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.063931 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.068688 (+ 4757us) server_negotiation.cc:407] Connection header received
0812 06:58:13.068752 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.068757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.068848 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.068954 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:13.074652 (+ 5698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.078321 (+ 3669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.080375 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.081022 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.081113 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.088891 (+ 7778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:13.088899 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:13.088904 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:13.088946 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:13.093415 (+ 4469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.094447 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.094453 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.094456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.094586 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.095024 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.095028 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.095031 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.095387 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:13.095660 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.096407 (+ 747us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.096721 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13886,"thread_start_us":13679,"threads_started":1}
I20260812 06:58:13.097760 692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.046237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50188 (local address 127.18.70.190:41895)
0812 06:58:13.074355 (+ 28118us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.074362 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.074384 (+ 22us) server_negotiation.cc:407] Connection header received
0812 06:58:13.074445 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.074451 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.074537 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.080286 (+ 5749us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:13.080567 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.081845 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.085283 (+ 3438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.085980 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.089949 (+ 3969us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.090237 (+ 288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:13.090242 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:13.090247 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:13.090278 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:13.094052 (+ 3774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.094965 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.094970 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.094974 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.095171 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.095593 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.095599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.095602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.095874 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:13.096157 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.097201 (+ 1044us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.097417 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27962,"thread_start_us":29399,"threads_started":1}
I20260812 06:58:13.102077 693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.049645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36954 (local address 127.18.70.188:38149)
0812 06:58:13.064960 (+ 15315us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.064968 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.082623 (+ 17655us) server_negotiation.cc:407] Connection header received
0812 06:58:13.082785 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.082790 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.082887 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.083002 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:13.087240 (+ 4238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.088454 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.090929 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.091631 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.091730 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.095280 (+ 3550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:13.095287 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:13.095292 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:13.095334 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:13.098922 (+ 3588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.099768 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.099774 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.099777 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.099952 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.100348 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.100353 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.100357 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.100652 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:13.100898 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.101263 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.101504 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14618,"thread_start_us":15329,"threads_started":1}
I20260812 06:58:13.102201 30715 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:58:13.109395 30715 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:58:13.138746 723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.128534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49058 (local address 127.18.70.130:38021)
0812 06:58:13.129032 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.129041 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.129070 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:58:13.129179 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.129188 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.129457 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.129652 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:13.133116 (+ 3464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.134601 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.136354 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.137714 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.137825 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.138071 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.138321 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.138474 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":581,"threads_started":1}
I20260812 06:58:13.138829 722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.127962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:38021 (local address 127.0.0.1:49058)
0812 06:58:13.128620 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:13.128641 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:13.128777 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:13.132571 (+ 3794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:13.132576 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:13.132602 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:13.132929 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.132940 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.134725 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.134729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.136212 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.136226 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.137937 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.137945 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.138148 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.138172 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 06:58:13.138260 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 06:58:13.138385 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":5,"thread_start_us":703,"threads_started":1}
I20260812 06:58:13.139459 728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.129270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46062 (local address 127.18.70.129:37567)
0812 06:58:13.130422 (+ 1152us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.130431 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.131108 (+ 677us) server_negotiation.cc:407] Connection header received
0812 06:58:13.131187 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.131192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.131339 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.131493 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:13.132200 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.133740 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.136123 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.137990 (+ 1867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.138109 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.138298 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.139093 (+ 795us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.139256 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":987,"thread_start_us":881,"threads_started":1}
I20260812 06:58:13.139999 725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.128799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:37567 (local address 127.0.0.1:46062)
0812 06:58:13.130855 (+ 2056us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:13.130872 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:13.130987 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:13.131513 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:13.131517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:13.131542 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:13.132000 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.132014 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.133846 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.133851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.135957 (+ 2106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.135972 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.138442 (+ 2470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.138448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.138674 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.138706 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 06:58:13.138783 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 06:58:13.139664 (+ 881us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1928,"mutex_wait_us":24,"thread_start_us":1795,"threads_started":1}
I20260812 06:58:13.141667 729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.129277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52720 (local address 127.18.70.131:35691)
0812 06:58:13.132606 (+ 3329us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.132611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.132633 (+ 22us) server_negotiation.cc:407] Connection header received
0812 06:58:13.132702 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.132707 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.132844 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.132994 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:13.134987 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.136434 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.139020 (+ 2586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.140302 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.140409 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.140599 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.141130 (+ 531us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.141282 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3196,"thread_start_us":3062,"threads_started":1}
I20260812 06:58:13.142742 32726 tablet_service.cc:1467] Processing CreateTablet for tablet a99ea3dc821b4a348e980e6e3abe9eef (DEFAULT_TABLE table=test-table [id=dc52102663794873a552261b0ae521d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:13.143059 32445 tablet_service.cc:1467] Processing CreateTablet for tablet a99ea3dc821b4a348e980e6e3abe9eef (DEFAULT_TABLE table=test-table [id=dc52102663794873a552261b0ae521d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:13.143939 32726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a99ea3dc821b4a348e980e6e3abe9eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:13.144141 32445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a99ea3dc821b4a348e980e6e3abe9eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:13.150315 727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.128991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:35691 (local address 127.0.0.1:52720)
0812 06:58:13.132070 (+ 3079us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:13.132085 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:13.132175 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:13.133185 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:13.133191 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:13.133215 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:13.133657 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.133671 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.136566 (+ 2895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.136570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.138649 (+ 2079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.138663 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.140484 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.140490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.140675 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.140702 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 06:58:13.140778 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 06:58:13.140890 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2952,"mutex_wait_us":19,"thread_start_us":2812,"threads_started":1}
I20260812 06:58:13.153870 548 tablet_service.cc:1467] Processing CreateTablet for tablet a99ea3dc821b4a348e980e6e3abe9eef (DEFAULT_TABLE table=test-table [id=dc52102663794873a552261b0ae521d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:13.155314 548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a99ea3dc821b4a348e980e6e3abe9eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:13.156086 731 tablet_bootstrap.cc:492] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: Bootstrap starting.
I20260812 06:58:13.158583 733 tablet_bootstrap.cc:492] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: Bootstrap starting.
I20260812 06:58:13.160068 731 tablet_bootstrap.cc:654] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:13.161368 731 log.cc:824] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:13.161849 733 tablet_bootstrap.cc:654] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:13.163009 733 log.cc:824] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:13.164440 731 tablet_bootstrap.cc:492] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: No bootstrap required, opened a new log
I20260812 06:58:13.164736 731 ts_tablet_manager.cc:1397] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260812 06:58:13.166292 733 tablet_bootstrap.cc:492] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: No bootstrap required, opened a new log
I20260812 06:58:13.166551 733 ts_tablet_manager.cc:1397] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260812 06:58:13.174623 739 tablet_bootstrap.cc:492] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: Bootstrap starting.
I20260812 06:58:13.175138 731 raft_consensus.cc:348] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } }
I20260812 06:58:13.175590 731 raft_consensus.cc:374] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:13.175702 731 raft_consensus.cc:729] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 258730b2e0564b759cb81826c6cb54c0, State: Initialized, Role: FOLLOWER
I20260812 06:58:13.176311 731 consensus_queue.cc:260] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } }
I20260812 06:58:13.176615 733 raft_consensus.cc:348] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } }
I20260812 06:58:13.177042 733 raft_consensus.cc:374] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:13.177142 733 raft_consensus.cc:729] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e2ba71074d645408b63648bfafd122c, State: Initialized, Role: FOLLOWER
I20260812 06:58:13.177769 733 consensus_queue.cc:260] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } }
I20260812 06:58:13.178393 739 tablet_bootstrap.cc:654] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:13.179785 391 heartbeater.cc:503] Master 127.18.70.190:41895 was elected leader, sending a full tablet report...
I20260812 06:58:13.179790 739 log.cc:824] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:13.181250 731 ts_tablet_manager.cc:1428] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: Time spent starting tablet: real 0.016s user 0.013s sys 0.001s
I20260812 06:58:13.184350 733 ts_tablet_manager.cc:1428] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: Time spent starting tablet: real 0.018s user 0.016s sys 0.000s
I20260812 06:58:13.191402 739 tablet_bootstrap.cc:492] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: No bootstrap required, opened a new log
I20260812 06:58:13.191650 739 ts_tablet_manager.cc:1397] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.005s
I20260812 06:58:13.199165 739 raft_consensus.cc:348] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } }
I20260812 06:58:13.199503 739 raft_consensus.cc:374] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:13.199571 739 raft_consensus.cc:729] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee6353114354080b7ebeb966697632d, State: Initialized, Role: FOLLOWER
I20260812 06:58:13.200062 739 consensus_queue.cc:260] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } }
I20260812 06:58:13.201045 663 heartbeater.cc:503] Master 127.18.70.190:41895 was elected leader, sending a full tablet report...
I20260812 06:58:13.201682 739 ts_tablet_manager.cc:1428] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
W20260812 06:58:13.267031 666 tablet.cc:2369] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:58:13.309260 32559 tablet.cc:2369] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:58:13.384418 746 raft_consensus.cc:482] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:58:13.384897 746 raft_consensus.cc:504] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } }
I20260812 06:58:13.387269 746 leader_election.cc:288] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 258730b2e0564b759cb81826c6cb54c0 (127.18.70.130:38021), 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567)
I20260812 06:58:13.396329 723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.387778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:51161 (local address 127.18.70.130:38021)
0812 06:58:13.388019 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.388027 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.388236 (+ 209us) server_negotiation.cc:407] Connection header received
0812 06:58:13.388341 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.388348 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.388443 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.388549 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:13.389381 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.390672 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.393746 (+ 3074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.395063 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.395245 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.395330 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.395892 (+ 562us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.396045 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 06:58:13.396329 728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.387915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:41737 (local address 127.18.70.129:37567)
0812 06:58:13.388145 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.388152 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.388177 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:58:13.388373 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.388378 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.388476 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.388569 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:13.389452 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.390680 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.393749 (+ 3069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.395089 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.395252 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.395330 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.395892 (+ 562us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.396055 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 06:58:13.396456 675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.387646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:37567 (local address 127.18.70.131:41737)
0812 06:58:13.388011 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:13.388025 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:13.388189 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:13.388615 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:13.388621 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:13.388654 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:13.389012 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.389135 (+ 123us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.390867 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.390873 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.393539 (+ 2666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.393560 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.395276 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.395283 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.395700 (+ 417us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.395755 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 06:58:13.395848 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 06:58:13.396090 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":437,"spinlock_wait_cycles":17152}
I20260812 06:58:13.396663 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.387695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:38021 (local address 127.18.70.131:51161)
0812 06:58:13.387998 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:13.388021 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:13.388189 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:13.388615 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:13.388621 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:13.388658 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:13.389009 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.389023 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.390867 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.390873 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.393539 (+ 2666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:13.393560 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.395276 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.395283 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:13.395700 (+ 417us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.395740 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 06:58:13.395848 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 06:58:13.396070 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":299,"spinlock_wait_cycles":55424}
I20260812 06:58:13.397586 32477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99ea3dc821b4a348e980e6e3abe9eef" candidate_uuid: "aee6353114354080b7ebeb966697632d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e2ba71074d645408b63648bfafd122c" is_pre_election: true
I20260812 06:58:13.397738 32766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99ea3dc821b4a348e980e6e3abe9eef" candidate_uuid: "aee6353114354080b7ebeb966697632d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "258730b2e0564b759cb81826c6cb54c0" is_pre_election: true
I20260812 06:58:13.398172 32477 raft_consensus.cc:2454] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee6353114354080b7ebeb966697632d in term 0.
I20260812 06:58:13.398257 32766 raft_consensus.cc:2454] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee6353114354080b7ebeb966697632d in term 0.
I20260812 06:58:13.398931 458 leader_election.cc:302] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0e2ba71074d645408b63648bfafd122c, 258730b2e0564b759cb81826c6cb54c0, aee6353114354080b7ebeb966697632d; no voters:
I20260812 06:58:13.399338 746 raft_consensus.cc:2781] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:58:13.399487 746 raft_consensus.cc:482] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:58:13.399605 746 raft_consensus.cc:3037] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:13.401859 746 raft_consensus.cc:504] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } }
I20260812 06:58:13.402529 746 leader_election.cc:288] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [CANDIDATE]: Term 1 election: Requested vote from peers 258730b2e0564b759cb81826c6cb54c0 (127.18.70.130:38021), 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567)
I20260812 06:58:13.402961 32766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99ea3dc821b4a348e980e6e3abe9eef" candidate_uuid: "aee6353114354080b7ebeb966697632d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "258730b2e0564b759cb81826c6cb54c0"
I20260812 06:58:13.403092 32477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99ea3dc821b4a348e980e6e3abe9eef" candidate_uuid: "aee6353114354080b7ebeb966697632d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e2ba71074d645408b63648bfafd122c"
I20260812 06:58:13.403185 32766 raft_consensus.cc:3037] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:13.403295 32477 raft_consensus.cc:3037] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:13.406589 32477 raft_consensus.cc:2454] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee6353114354080b7ebeb966697632d in term 1.
I20260812 06:58:13.407166 458 leader_election.cc:302] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e2ba71074d645408b63648bfafd122c, aee6353114354080b7ebeb966697632d; no voters:
I20260812 06:58:13.407557 746 raft_consensus.cc:2781] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:13.408264 746 raft_consensus.cc:686] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 1 LEADER]: Becoming Leader. State: Replica: aee6353114354080b7ebeb966697632d, State: Running, Role: LEADER
I20260812 06:58:13.408812 746 consensus_queue.cc:237] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } }
W20260812 06:58:13.408946 395 tablet.cc:2369] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:58:13.410718 32766 raft_consensus.cc:2454] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee6353114354080b7ebeb966697632d in term 1.
I20260812 06:58:13.415676 30713 catalog_manager.cc:5495] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d reported cstate change: term changed from 0 to 1, leader changed from <none> to aee6353114354080b7ebeb966697632d (127.18.70.131). New cstate: current_term: 1 leader_uuid: "aee6353114354080b7ebeb966697632d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } health_report { overall_health: UNKNOWN } } }
I20260812 06:58:13.440194 729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.434339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52732 (local address 127.18.70.131:35691)
0812 06:58:13.434560 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.434567 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.434745 (+ 178us) server_negotiation.cc:407] Connection header received
0812 06:58:13.435033 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.435040 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.435161 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.435335 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:58:13.435751 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.436504 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.438039 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.438454 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.438557 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.439104 (+ 547us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:58:13.439611 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:58:13.439729 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.439836 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.439902 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 06:58:13.448661 32477 raft_consensus.cc:1261] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c [term 1 FOLLOWER]: Refusing update from remote peer aee6353114354080b7ebeb966697632d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:13.448662 32766 raft_consensus.cc:1261] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0 [term 1 FOLLOWER]: Refusing update from remote peer aee6353114354080b7ebeb966697632d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:13.449553 747 consensus_queue.cc:1035] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:13.449913 746 consensus_queue.cc:1035] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [LEADER]: Connected to new peer: Peer: permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:13.462952 752 mvcc.cc:205] Tried to move back new op lower bound from 7317577291556384768 to 7317577291407273984. Current Snapshot: MvccSnapshot[applied={T|T < 7317577291556384768}]
I20260812 06:58:13.486667 30715 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:13.487056 30715 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:13.494107 30715 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 11de1582002747b0aee38b0a00cac210: Sending DeleteTablet for 3 replicas of tablet a99ea3dc821b4a348e980e6e3abe9eef
I20260812 06:58:13.495604 32726 tablet_service.cc:1514] Processing DeleteTablet for tablet a99ea3dc821b4a348e980e6e3abe9eef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:13 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:49058
I20260812 06:58:13.495800 548 tablet_service.cc:1514] Processing DeleteTablet for tablet a99ea3dc821b4a348e980e6e3abe9eef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:13 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:52720
I20260812 06:58:13.496106 32445 tablet_service.cc:1514] Processing DeleteTablet for tablet a99ea3dc821b4a348e980e6e3abe9eef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:13 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:46062
I20260812 06:58:13.496968 775 tablet_replica.cc:330] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: stopping tablet replica
I20260812 06:58:13.497236 780 tablet_replica.cc:330] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: stopping tablet replica
I20260812 06:58:13.497684 780 raft_consensus.cc:2229] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:13.498275 780 raft_consensus.cc:2258] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:13.500952 775 raft_consensus.cc:2229] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:13.501407 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 30648
I20260812 06:58:13.501482 775 raft_consensus.cc:2258] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:13.502508 30767 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:13.504173 775 ts_tablet_manager.cc:1905] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:13.507097 780 ts_tablet_manager.cc:1905] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:13.508909 779 tablet_replica.cc:330] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: stopping tablet replica
I20260812 06:58:13.509389 779 raft_consensus.cc:2229] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:58:13.510221 779 raft_consensus.cc:2258] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:13.512451 779 ts_tablet_manager.cc:1905] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:13.518175 775 ts_tablet_manager.cc:1918] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:13.519884 779 ts_tablet_manager.cc:1918] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:13.520076 779 log.cc:1196] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/a99ea3dc821b4a348e980e6e3abe9eef
I20260812 06:58:13.520687 779 ts_tablet_manager.cc:1939] T a99ea3dc821b4a348e980e6e3abe9eef P aee6353114354080b7ebeb966697632d: Deleting consensus metadata
I20260812 06:58:13.521104 780 ts_tablet_manager.cc:1918] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:13.521279 780 log.cc:1196] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/a99ea3dc821b4a348e980e6e3abe9eef
I20260812 06:58:13.521875 780 ts_tablet_manager.cc:1939] T a99ea3dc821b4a348e980e6e3abe9eef P 0e2ba71074d645408b63648bfafd122c: Deleting consensus metadata
I20260812 06:58:13.524889 775 log.cc:1196] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/a99ea3dc821b4a348e980e6e3abe9eef
I20260812 06:58:13.525470 775 ts_tablet_manager.cc:1939] T a99ea3dc821b4a348e980e6e3abe9eef P 258730b2e0564b759cb81826c6cb54c0: Deleting consensus metadata
I20260812 06:58:13.531145 694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.498994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37724 (local address 127.18.70.189:44517)
0812 06:58:13.499469 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.499476 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.500434 (+ 958us) server_negotiation.cc:407] Connection header received
0812 06:58:13.504439 (+ 4005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.504446 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.504688 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.504787 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:13.509640 (+ 4853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.510729 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.519347 (+ 8618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.520084 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.520215 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.524999 (+ 4784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:13.525007 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:13.525011 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:13.525055 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:13.528073 (+ 3018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.528893 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.528898 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.528902 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.529058 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.529458 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.529463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.529467 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.529821 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:13.530142 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.530491 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.530745 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308}
I20260812 06:58:13.547276 693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.500684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36960 (local address 127.18.70.188:38149)
0812 06:58:13.500907 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.500914 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.531117 (+ 30203us) server_negotiation.cc:407] Connection header received
0812 06:58:13.531418 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.531425 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.531522 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.531629 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:13.533268 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.534384 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.536261 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.536822 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.536935 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.540248 (+ 3313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:13.540255 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:13.540261 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:13.540319 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:13.543992 (+ 3673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.544938 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.544949 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.544952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.545111 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.545565 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.545571 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.545574 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.546043 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:13.546326 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.546679 (+ 353us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.546923 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 06:58:13.648216 30689 catalog_manager.cc:4841] TS 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567): tablet a99ea3dc821b4a348e980e6e3abe9eef (table test-table [id=dc52102663794873a552261b0ae521d1]) successfully deleted
W20260812 06:58:13.648648 30689 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.70.129:37567, user_credentials={real_user=slave}} blocked reactor thread for 124953us
I20260812 06:58:13.649279 30688 catalog_manager.cc:4841] TS aee6353114354080b7ebeb966697632d (127.18.70.131:35691): tablet a99ea3dc821b4a348e980e6e3abe9eef (table test-table [id=dc52102663794873a552261b0ae521d1]) successfully deleted
W20260812 06:58:13.649464 30688 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.70.131:35691, user_credentials={real_user=slave}} blocked reactor thread for 126917us
I20260812 06:58:13.649878 30688 catalog_manager.cc:4841] TS 258730b2e0564b759cb81826c6cb54c0 (127.18.70.130:38021): tablet a99ea3dc821b4a348e980e6e3abe9eef (table test-table [id=dc52102663794873a552261b0ae521d1]) successfully deleted
I20260812 06:58:13.650254 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 30648
I20260812 06:58:13.704854 694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.687383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37738 (local address 127.18.70.189:44517)
0812 06:58:13.687735 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.687742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.688484 (+ 742us) server_negotiation.cc:407] Connection header received
0812 06:58:13.688557 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.688562 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.688643 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.688731 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:13.691093 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.692231 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.694167 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.694679 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.694796 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.698270 (+ 3474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:13.698274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:13.698278 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:13.698308 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:13.701596 (+ 3288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.702442 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.702448 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.702452 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.702600 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.703006 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.703011 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.703014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.703402 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:13.703764 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.704066 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.704469 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232}
I20260812 06:58:13.706429 693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:13.687561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36976 (local address 127.18.70.188:38149)
0812 06:58:13.688924 (+ 1363us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:13.688930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:13.692096 (+ 3166us) server_negotiation.cc:407] Connection header received
0812 06:58:13.692505 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:13.692510 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:13.692573 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:13.692651 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:13.694393 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.695461 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.696887 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:13.697412 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:13.697526 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:13.700501 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:13.700506 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:13.700509 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:13.700540 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:13.703523 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.704333 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.704339 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.704343 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.704478 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:13.704885 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:13.704890 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:13.704894 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:13.705261 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:13.705488 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:13.706036 (+ 548us) server_negotiation.cc:299] Negotiation successful
0812 06:58:13.706198 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213}
I20260812 06:58:14.471876 796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:14.471080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.129:46313)
0812 06:58:14.471574 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:14.471700 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":240,"threads_started":1}
W20260812 06:58:14.472268 32555 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:41895 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
I20260812 06:58:14.477689 797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:14.476732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.131:54557)
0812 06:58:14.477299 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:14.477462 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"threads_started":1}
I20260812 06:58:14.478091 798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:14.476938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.130:47535)
0812 06:58:14.477681 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:14.477868 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":523,"threads_started":1}
W20260812 06:58:14.478561 663 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:41895 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
W20260812 06:58:14.478590 391 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:41895 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
I20260812 06:58:14.995457 801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 11de1582002747b0aee38b0a00cac210)
I20260812 06:58:14.995751 801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } }
I20260812 06:58:14.995846 802 raft_consensus.cc:482] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 11de1582002747b0aee38b0a00cac210)
I20260812 06:58:14.996121 802 raft_consensus.cc:504] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } }
I20260812 06:58:14.997148 801 leader_election.cc:288] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11de1582002747b0aee38b0a00cac210 (127.18.70.190:41895), 650b2a15db3e447eb8f54de83b9aa779 (127.18.70.188:38149)
I20260812 06:58:14.998167 802 leader_election.cc:288] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11de1582002747b0aee38b0a00cac210 (127.18.70.190:41895), 511926043ba14cb7a6a534d10fe668c4 (127.18.70.189:44517)
I20260812 06:58:14.998706 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:14.997396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50618)
0812 06:58:14.997981 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:14.998172 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":289,"threads_started":1}
W20260812 06:58:14.998971 32204 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
I20260812 06:58:14.999181 805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:14.997307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50610)
0812 06:58:14.998801 (+ 1494us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:14.998961 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1393,"thread_start_us":1232,"threads_started":1}
W20260812 06:58:14.999493 31827 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
I20260812 06:58:15.000963 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.000535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50628)
0812 06:58:15.000675 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.000785 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 06:58:15.001775 32204 leader_election.cc:334] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 11de1582002747b0aee38b0a00cac210 (127.18.70.190:41895): Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
I20260812 06:58:15.002035 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.001243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50634)
0812 06:58:15.001483 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.001684 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260812 06:58:15.002497 31827 leader_election.cc:334] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 11de1582002747b0aee38b0a00cac210 (127.18.70.190:41895): Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
I20260812 06:58:15.007166 805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:14.997365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:38149 (local address 127.0.0.1:36990)
0812 06:58:14.999364 (+ 1999us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:14.999382 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:14.999512 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:15.001385 (+ 1873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:15.001390 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:15.001417 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:15.001719 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.001732 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.003468 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.003473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.004948 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.004961 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.006551 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.006556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.006690 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.006719 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 06:58:15.006796 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 06:58:15.006926 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1917,"thread_start_us":1070,"threads_started":1}
I20260812 06:58:15.007359 806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:14.997657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36990 (local address 127.18.70.188:38149)
0812 06:58:15.001060 (+ 3403us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:15.001066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:15.001084 (+ 18us) server_negotiation.cc:407] Connection header received
0812 06:58:15.001153 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:15.001158 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:15.001227 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:15.001870 (+ 643us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:15.002192 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.003329 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.005088 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.006412 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.006536 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.006634 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:15.006839 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 06:58:15.006970 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3292,"thread_start_us":3147,"threads_started":1}
I20260812 06:58:15.007885 32257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "511926043ba14cb7a6a534d10fe668c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "650b2a15db3e447eb8f54de83b9aa779" is_pre_election: true
I20260812 06:58:15.008177 32257 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 511926043ba14cb7a6a534d10fe668c4 in term 1.
I20260812 06:58:15.008641 31832 leader_election.cc:302] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 511926043ba14cb7a6a534d10fe668c4, 650b2a15db3e447eb8f54de83b9aa779; no voters: 11de1582002747b0aee38b0a00cac210
I20260812 06:58:15.009006 801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:58:15.009136 801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 11de1582002747b0aee38b0a00cac210)
I20260812 06:58:15.009231 801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:58:15.010123 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.001084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:44517 (local address 127.0.0.1:37742)
0812 06:58:15.001482 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.001505 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:15.001601 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:15.003578 (+ 1977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:15.003584 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:15.003615 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:15.003869 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.003879 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.005220 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.005225 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.007141 (+ 1916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.007157 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.009362 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.009368 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.009562 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.009596 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 06:58:15.009685 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 06:58:15.009819 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":2546,"threads_started":1}
I20260812 06:58:15.010255 812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.001169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37742 (local address 127.18.70.189:44517)
0812 06:58:15.003185 (+ 2016us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:15.003192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:15.003217 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:58:15.003275 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:15.003281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:15.003350 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:15.003986 (+ 636us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:15.004207 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.005097 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.007766 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.009023 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.009145 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.009250 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:15.009738 (+ 488us) server_negotiation.cc:299] Negotiation successful
0812 06:58:15.009872 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":1891,"thread_start_us":1719,"threads_started":1}
I20260812 06:58:15.010818 31877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "650b2a15db3e447eb8f54de83b9aa779" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "511926043ba14cb7a6a534d10fe668c4" is_pre_election: true
I20260812 06:58:15.011929 801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } }
I20260812 06:58:15.012377 31877 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 650b2a15db3e447eb8f54de83b9aa779 in current term 2: Already voted for candidate 511926043ba14cb7a6a534d10fe668c4 in this term.
I20260812 06:58:15.012663 801 leader_election.cc:288] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [CANDIDATE]: Term 2 election: Requested vote from peers 11de1582002747b0aee38b0a00cac210 (127.18.70.190:41895), 650b2a15db3e447eb8f54de83b9aa779 (127.18.70.188:38149)
I20260812 06:58:15.013090 805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.012730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50638)
0812 06:58:15.012908 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.012973 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260812 06:58:15.013926 32257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "511926043ba14cb7a6a534d10fe668c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "650b2a15db3e447eb8f54de83b9aa779"
I20260812 06:58:15.014071 805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.013680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50650)
0812 06:58:15.013817 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.013944 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 06:58:15.014142 32257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:58:15.014101 32206 leader_election.cc:302] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 650b2a15db3e447eb8f54de83b9aa779; no voters: 11de1582002747b0aee38b0a00cac210, 511926043ba14cb7a6a534d10fe668c4
W20260812 06:58:15.014235 31827 leader_election.cc:334] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 11de1582002747b0aee38b0a00cac210 (127.18.70.190:41895): Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
I20260812 06:58:15.016275 32257 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 511926043ba14cb7a6a534d10fe668c4 in term 2.
I20260812 06:58:15.016439 802 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:58:15.016614 31832 leader_election.cc:302] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 511926043ba14cb7a6a534d10fe668c4, 650b2a15db3e447eb8f54de83b9aa779; no voters: 11de1582002747b0aee38b0a00cac210
I20260812 06:58:15.016875 801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:58:15.017282 801 raft_consensus.cc:686] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [term 2 LEADER]: Becoming Leader. State: Replica: 511926043ba14cb7a6a534d10fe668c4, State: Running, Role: LEADER
I20260812 06:58:15.017635 801 consensus_queue.cc:237] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } }
I20260812 06:58:15.020015 813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 511926043ba14cb7a6a534d10fe668c4. Latest consensus state: current_term: 2 leader_uuid: "511926043ba14cb7a6a534d10fe668c4" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:15.020363 813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:15.020949 818 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:58:15.024402 818 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:58:15.025205 818 catalog_manager.cc:1259] Loaded cluster ID: bcbaf79111ab42b08ea3692545479e35
I20260812 06:58:15.025281 818 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:58:15.026444 818 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:58:15.027235 818 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: Loaded TSK: 0
I20260812 06:58:15.028036 818 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:58:15.044454 31862 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37738:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:58:15.051399 31862 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:58:15.055356 805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.054920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50672)
0812 06:58:15.055124 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.055219 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 06:58:15.055512 32257 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [term 2 FOLLOWER]: Refusing update from remote peer 511926043ba14cb7a6a534d10fe668c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 06:58:15.056267 805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.055924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50684)
0812 06:58:15.056063 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.056134 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 06:58:15.056188 813 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260812 06:58:15.056433 31827 consensus_peers.cc:487] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 -> Peer 11de1582002747b0aee38b0a00cac210 (127.18.70.190:41895): Couldn't send request to peer 11de1582002747b0aee38b0a00cac210. Status: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:58:15.058869 802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 511926043ba14cb7a6a534d10fe668c4. Latest consensus state: current_term: 2 leader_uuid: "511926043ba14cb7a6a534d10fe668c4" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:15.059134 802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:58:15.060606 813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "511926043ba14cb7a6a534d10fe668c4" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:15.060870 813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:15.061156 802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "511926043ba14cb7a6a534d10fe668c4" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "11de1582002747b0aee38b0a00cac210" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41895 } } peers { permanent_uuid: "511926043ba14cb7a6a534d10fe668c4" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 44517 } attrs { promote: false } } peers { permanent_uuid: "650b2a15db3e447eb8f54de83b9aa779" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 38149 } attrs { promote: false } } }
I20260812 06:58:15.061394 802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650b2a15db3e447eb8f54de83b9aa779 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:58:15.076354 805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.068806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:37567 (local address 127.0.0.1:46074)
0812 06:58:15.069026 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.069047 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:15.069164 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:15.070059 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:15.070065 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:15.070096 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:15.070332 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.070343 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.071900 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.071906 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.073904 (+ 1998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.073922 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.075540 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.075547 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.075771 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.075812 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 06:58:15.075885 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 06:58:15.076030 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 06:58:15.077675 832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.068939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46074 (local address 127.18.70.129:37567)
0812 06:58:15.069677 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:15.069683 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:15.069701 (+ 18us) server_negotiation.cc:407] Connection header received
0812 06:58:15.069778 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:15.069785 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:15.069868 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:15.070472 (+ 604us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:15.070650 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.071746 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.074173 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.075353 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.076976 (+ 1623us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.077095 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:15.077150 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 06:58:15.077305 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":525,"threads_started":1}
I20260812 06:58:15.078575 32445 tablet_service.cc:1467] Processing CreateTablet for tablet 96666faacb854059b8f854c76f68deb3 (DEFAULT_TABLE table=test-table [id=bb4f44caac1b496e8dedf557312df461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:15.079108 32445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96666faacb854059b8f854c76f68deb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:15.085672 805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.069795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:38021 (local address 127.0.0.1:49074)
0812 06:58:15.076577 (+ 6782us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.076593 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:15.076710 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:15.078700 (+ 1990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:15.078704 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:15.078729 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:15.078915 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.078927 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.080463 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.080469 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.082522 (+ 2053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.082538 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.085008 (+ 2470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.085014 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.085277 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.085318 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 06:58:15.085380 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:58:15.085476 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6705,"thread_start_us":15603,"threads_started":1}
I20260812 06:58:15.086339 836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.069991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49074 (local address 127.18.70.130:38021)
0812 06:58:15.078324 (+ 8333us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:15.078332 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:15.078354 (+ 22us) server_negotiation.cc:407] Connection header received
0812 06:58:15.078443 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:15.078449 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:15.078541 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:15.079048 (+ 507us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:15.079212 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.080303 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.082738 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.084478 (+ 1740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.085881 (+ 1403us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.086001 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:15.086042 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 06:58:15.086137 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8186,"thread_start_us":15921,"threads_started":1}
I20260812 06:58:15.087102 32726 tablet_service.cc:1467] Processing CreateTablet for tablet 96666faacb854059b8f854c76f68deb3 (DEFAULT_TABLE table=test-table [id=bb4f44caac1b496e8dedf557312df461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:15.087527 32726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96666faacb854059b8f854c76f68deb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:15.090698 840 tablet_bootstrap.cc:492] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c: Bootstrap starting.
I20260812 06:58:15.091922 835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.069648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52742 (local address 127.18.70.131:35691)
0812 06:58:15.084142 (+ 14494us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:15.084148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:15.084167 (+ 19us) server_negotiation.cc:407] Connection header received
0812 06:58:15.084633 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:15.084639 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:15.084717 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:15.084810 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:15.086653 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.087569 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.089826 (+ 2257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.090958 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.091083 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.091182 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:15.091542 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 06:58:15.091662 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14364,"thread_start_us":14991,"threads_started":1}
I20260812 06:58:15.091962 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.069527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:35691 (local address 127.0.0.1:52742)
0812 06:58:15.070028 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.070045 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:15.070161 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:15.084851 (+ 14690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:15.084856 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:15.084883 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:15.085223 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.085236 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.087725 (+ 2489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.087730 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.089625 (+ 1895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.089640 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.091174 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.091180 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.091369 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.091405 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:58:15.091516 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 06:58:15.091662 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"spinlock_wait_cycles":3840}
I20260812 06:58:15.092466 840 tablet_bootstrap.cc:654] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:15.092819 548 tablet_service.cc:1467] Processing CreateTablet for tablet 96666faacb854059b8f854c76f68deb3 (DEFAULT_TABLE table=test-table [id=bb4f44caac1b496e8dedf557312df461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:15.093259 548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96666faacb854059b8f854c76f68deb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:15.094988 840 tablet_bootstrap.cc:492] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c: No bootstrap required, opened a new log
I20260812 06:58:15.095180 840 ts_tablet_manager.cc:1397] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 06:58:15.095360 845 tablet_bootstrap.cc:492] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0: Bootstrap starting.
I20260812 06:58:15.096041 840 raft_consensus.cc:348] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } }
I20260812 06:58:15.096328 840 raft_consensus.cc:374] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:15.096427 840 raft_consensus.cc:729] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e2ba71074d645408b63648bfafd122c, State: Initialized, Role: FOLLOWER
I20260812 06:58:15.096688 840 consensus_queue.cc:260] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } }
I20260812 06:58:15.097213 845 tablet_bootstrap.cc:654] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:15.098695 840 ts_tablet_manager.cc:1428] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260812 06:58:15.099871 845 tablet_bootstrap.cc:492] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0: No bootstrap required, opened a new log
I20260812 06:58:15.100019 845 ts_tablet_manager.cc:1397] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 06:58:15.100066 849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.099304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.129:48595)
0812 06:58:15.099729 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.099846 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"threads_started":1}
I20260812 06:58:15.100839 845 raft_consensus.cc:348] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } }
I20260812 06:58:15.101094 845 raft_consensus.cc:374] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:15.101203 845 raft_consensus.cc:729] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 258730b2e0564b759cb81826c6cb54c0, State: Initialized, Role: FOLLOWER
I20260812 06:58:15.101469 845 consensus_queue.cc:260] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } }
I20260812 06:58:15.103642 845 ts_tablet_manager.cc:1428] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:58:15.104490 32557 heartbeater.cc:503] Master 127.18.70.189:44517 was elected leader, sending a full tablet report...
I20260812 06:58:15.105378 393 heartbeater.cc:503] Master 127.18.70.189:44517 was elected leader, sending a full tablet report...
I20260812 06:58:15.107399 849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.102321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.129:46699)
0812 06:58:15.107215 (+ 4894us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.107285 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4809}
I20260812 06:58:15.107712 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.104213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.130:55263)
0812 06:58:15.107289 (+ 3076us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.107453 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2935,"thread_start_us":2794,"threads_started":1}
I20260812 06:58:15.108884 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.108509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.130:48565)
0812 06:58:15.108691 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.108775 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 06:58:15.110396 854 tablet_bootstrap.cc:492] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d: Bootstrap starting.
I20260812 06:58:15.111776 854 tablet_bootstrap.cc:654] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:15.113523 854 tablet_bootstrap.cc:492] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d: No bootstrap required, opened a new log
I20260812 06:58:15.113653 854 ts_tablet_manager.cc:1397] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:58:15.114297 854 raft_consensus.cc:348] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } }
I20260812 06:58:15.114482 854 raft_consensus.cc:374] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:15.114576 854 raft_consensus.cc:729] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee6353114354080b7ebeb966697632d, State: Initialized, Role: FOLLOWER
I20260812 06:58:15.114784 854 consensus_queue.cc:260] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } }
I20260812 06:58:15.115437 854 ts_tablet_manager.cc:1428] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:58:15.117862 664 heartbeater.cc:503] Master 127.18.70.189:44517 was elected leader, sending a full tablet report...
I20260812 06:58:15.118764 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.115773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.131:33319)
0812 06:58:15.118372 (+ 2599us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.118508 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2479,"thread_start_us":2348,"threads_started":1}
I20260812 06:58:15.119966 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.119677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.131:35105)
0812 06:58:15.119794 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.119857 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 06:58:15.437743 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.437334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50694)
0812 06:58:15.437496 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.437586 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 06:58:15.438695 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.438377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50698)
0812 06:58:15.438496 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.438578 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 06:58:15.543699 857 raft_consensus.cc:482] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:58:15.543933 857 raft_consensus.cc:504] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } }
I20260812 06:58:15.545677 857 leader_election.cc:288] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567), aee6353114354080b7ebeb966697632d (127.18.70.131:35691)
I20260812 06:58:15.551731 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.545971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:37567 (local address 127.18.70.130:52851)
0812 06:58:15.546251 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.546278 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:15.546464 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:15.546868 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:15.546873 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:15.546901 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:15.547231 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.547245 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.548322 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.548328 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.549813 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.549826 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.551001 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.551008 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.551197 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.551221 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 06:58:15.551295 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:58:15.551432 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162}
I20260812 06:58:15.551738 832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.546116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:52851 (local address 127.18.70.129:37567)
0812 06:58:15.546292 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:15.546297 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:15.546365 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:58:15.546658 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:15.546665 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:15.546746 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:15.546835 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:15.547360 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.548191 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.549989 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.550784 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.550906 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.550980 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:15.551349 (+ 369us) server_negotiation.cc:299] Negotiation successful
0812 06:58:15.551490 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 06:58:15.551787 835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.546082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:33155 (local address 127.18.70.131:35691)
0812 06:58:15.546273 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:15.546280 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:15.546833 (+ 553us) server_negotiation.cc:407] Connection header received
0812 06:58:15.546995 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:15.547000 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:15.547072 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:15.547163 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:15.547706 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.548461 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.550132 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.550883 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.551022 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.551094 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:15.551431 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 06:58:15.551568 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 06:58:15.551862 866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.546032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:35691 (local address 127.18.70.130:33155)
0812 06:58:15.546726 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.546742 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:15.546870 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:15.547187 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:15.547190 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:15.547213 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:15.547563 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.547577 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.548592 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.548596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.549982 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:15.549995 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.551095 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.551100 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:15.551243 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.551268 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 06:58:15.551399 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 06:58:15.551524 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":413,"threads_started":1}
I20260812 06:58:15.552573 864 raft_consensus.cc:482] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:58:15.552556 32477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96666faacb854059b8f854c76f68deb3" candidate_uuid: "258730b2e0564b759cb81826c6cb54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e2ba71074d645408b63648bfafd122c" is_pre_election: true
I20260812 06:58:15.552815 32477 raft_consensus.cc:2454] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 258730b2e0564b759cb81826c6cb54c0 in term 0.
I20260812 06:58:15.552752 864 raft_consensus.cc:504] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } }
I20260812 06:58:15.552817 580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96666faacb854059b8f854c76f68deb3" candidate_uuid: "258730b2e0564b759cb81826c6cb54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee6353114354080b7ebeb966697632d" is_pre_election: true
I20260812 06:58:15.553246 580 raft_consensus.cc:2454] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 258730b2e0564b759cb81826c6cb54c0 in term 0.
I20260812 06:58:15.553396 32632 leader_election.cc:302] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e2ba71074d645408b63648bfafd122c, 258730b2e0564b759cb81826c6cb54c0; no voters:
I20260812 06:58:15.553812 857 raft_consensus.cc:2781] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:58:15.553925 32477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96666faacb854059b8f854c76f68deb3" candidate_uuid: "aee6353114354080b7ebeb966697632d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e2ba71074d645408b63648bfafd122c" is_pre_election: true
I20260812 06:58:15.554042 857 raft_consensus.cc:482] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:58:15.554145 857 raft_consensus.cc:3037] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:15.554157 32477 raft_consensus.cc:2454] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee6353114354080b7ebeb966697632d in term 0.
I20260812 06:58:15.554276 32766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96666faacb854059b8f854c76f68deb3" candidate_uuid: "aee6353114354080b7ebeb966697632d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "258730b2e0564b759cb81826c6cb54c0" is_pre_election: true
I20260812 06:58:15.554592 864 leader_election.cc:288] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567), 258730b2e0564b759cb81826c6cb54c0 (127.18.70.130:38021)
I20260812 06:58:15.554561 458 leader_election.cc:302] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e2ba71074d645408b63648bfafd122c, aee6353114354080b7ebeb966697632d; no voters:
I20260812 06:58:15.554857 864 raft_consensus.cc:2781] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:58:15.554960 864 raft_consensus.cc:482] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:58:15.555049 864 raft_consensus.cc:3037] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:15.557082 857 raft_consensus.cc:504] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } }
I20260812 06:58:15.557500 32766 raft_consensus.cc:2379] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aee6353114354080b7ebeb966697632d in current term 1: Already voted for candidate 258730b2e0564b759cb81826c6cb54c0 in this term.
I20260812 06:58:15.557791 857 leader_election.cc:288] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [CANDIDATE]: Term 1 election: Requested vote from peers 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567), aee6353114354080b7ebeb966697632d (127.18.70.131:35691)
I20260812 06:58:15.558086 580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96666faacb854059b8f854c76f68deb3" candidate_uuid: "258730b2e0564b759cb81826c6cb54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee6353114354080b7ebeb966697632d"
I20260812 06:58:15.558350 32477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96666faacb854059b8f854c76f68deb3" candidate_uuid: "258730b2e0564b759cb81826c6cb54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e2ba71074d645408b63648bfafd122c"
I20260812 06:58:15.558525 32477 raft_consensus.cc:3037] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:15.560081 864 raft_consensus.cc:504] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } }
I20260812 06:58:15.560464 580 raft_consensus.cc:2379] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 258730b2e0564b759cb81826c6cb54c0 in current term 1: Already voted for candidate aee6353114354080b7ebeb966697632d in this term.
I20260812 06:58:15.561214 32766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96666faacb854059b8f854c76f68deb3" candidate_uuid: "aee6353114354080b7ebeb966697632d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "258730b2e0564b759cb81826c6cb54c0"
I20260812 06:58:15.561252 32475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96666faacb854059b8f854c76f68deb3" candidate_uuid: "aee6353114354080b7ebeb966697632d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e2ba71074d645408b63648bfafd122c"
I20260812 06:58:15.561419 32766 raft_consensus.cc:2379] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aee6353114354080b7ebeb966697632d in current term 1: Already voted for candidate 258730b2e0564b759cb81826c6cb54c0 in this term.
I20260812 06:58:15.561980 457 leader_election.cc:302] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee6353114354080b7ebeb966697632d; no voters: 0e2ba71074d645408b63648bfafd122c, 258730b2e0564b759cb81826c6cb54c0
I20260812 06:58:15.562011 32477 raft_consensus.cc:2454] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 258730b2e0564b759cb81826c6cb54c0 in term 1.
I20260812 06:58:15.562265 864 leader_election.cc:288] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [CANDIDATE]: Term 1 election: Requested vote from peers 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567), 258730b2e0564b759cb81826c6cb54c0 (127.18.70.130:38021)
I20260812 06:58:15.562429 864 raft_consensus.cc:2726] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 06:58:15.562386 32632 leader_election.cc:302] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e2ba71074d645408b63648bfafd122c, 258730b2e0564b759cb81826c6cb54c0; no voters: aee6353114354080b7ebeb966697632d
I20260812 06:58:15.562687 857 raft_consensus.cc:2781] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:15.563124 857 raft_consensus.cc:686] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 1 LEADER]: Becoming Leader. State: Replica: 258730b2e0564b759cb81826c6cb54c0, State: Running, Role: LEADER
I20260812 06:58:15.563544 857 consensus_queue.cc:237] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } }
I20260812 06:58:15.564536 866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.563950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.130:34471)
0812 06:58:15.564222 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.564345 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20260812 06:58:15.567545 31861 catalog_manager.cc:5495] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 258730b2e0564b759cb81826c6cb54c0 (127.18.70.130). New cstate: current_term: 1 leader_uuid: "258730b2e0564b759cb81826c6cb54c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "258730b2e0564b759cb81826c6cb54c0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38021 } health_report { overall_health: HEALTHY } } }
I20260812 06:58:15.639292 887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.634407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49088 (local address 127.18.70.130:38021)
0812 06:58:15.634852 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:15.634856 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:15.634875 (+ 19us) server_negotiation.cc:407] Connection header received
0812 06:58:15.635060 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:15.635064 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:15.635144 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:15.635281 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:58:15.635585 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.636247 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.637411 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.637795 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.637882 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.638240 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:58:15.638804 (+ 564us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:58:15.638910 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:15.638949 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 06:58:15.639015 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":236,"threads_started":1}
I20260812 06:58:15.643018 32477 raft_consensus.cc:1261] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c [term 1 FOLLOWER]: Refusing update from remote peer 258730b2e0564b759cb81826c6cb54c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:15.643261 580 raft_consensus.cc:1261] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 1 FOLLOWER]: Refusing update from remote peer 258730b2e0564b759cb81826c6cb54c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:15.643632 857 consensus_queue.cc:1035] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e2ba71074d645408b63648bfafd122c" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 37567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:15.643954 873 consensus_queue.cc:1035] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee6353114354080b7ebeb966697632d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:15.647255 903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.646424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.129:49271)
0812 06:58:15.646858 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.647028 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":215,"threads_started":1}
I20260812 06:58:15.650632 899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.646336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.131:49645)
0812 06:58:15.650270 (+ 3934us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.650394 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3808,"thread_start_us":3722,"threads_started":1}
I20260812 06:58:15.654840 903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.654376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.129:36813)
0812 06:58:15.654587 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.654672 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260812 06:58:15.662683 866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.661769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.130:52977)
0812 06:58:15.662397 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.662497 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506}
I20260812 06:58:15.672807 866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.671447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.130:32789)
0812 06:58:15.672554 (+ 1107us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.672643 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":982}
I20260812 06:58:15.674768 899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.674291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.18.70.131:52889)
0812 06:58:15.674544 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:15.674624 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260812 06:58:15.683530 31862 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:15.683802 31862 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:15.690047 31862 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 511926043ba14cb7a6a534d10fe668c4: Sending DeleteTablet for 3 replicas of tablet 96666faacb854059b8f854c76f68deb3
I20260812 06:58:15.690960 32445 tablet_service.cc:1514] Processing DeleteTablet for tablet 96666faacb854059b8f854c76f68deb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:15 UTC) from {username='oryx', principal='oryx/127.18.70.189@KRBTEST.COM'} at 127.0.0.1:46074
I20260812 06:58:15.691057 548 tablet_service.cc:1514] Processing DeleteTablet for tablet 96666faacb854059b8f854c76f68deb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:15 UTC) from {username='oryx', principal='oryx/127.18.70.189@KRBTEST.COM'} at 127.0.0.1:52742
I20260812 06:58:15.691339 32726 tablet_service.cc:1514] Processing DeleteTablet for tablet 96666faacb854059b8f854c76f68deb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:15 UTC) from {username='oryx', principal='oryx/127.18.70.189@KRBTEST.COM'} at 127.0.0.1:49074
I20260812 06:58:15.694263 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 32203
I20260812 06:58:15.707744 913 tablet_replica.cc:330] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c: stopping tablet replica
I20260812 06:58:15.707989 913 raft_consensus.cc:2229] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:15.708304 913 raft_consensus.cc:2258] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:15.710327 913 ts_tablet_manager.cc:1905] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:15.711052 916 tablet_replica.cc:330] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0: stopping tablet replica
I20260812 06:58:15.713335 916 raft_consensus.cc:2229] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:58:15.714128 916 raft_consensus.cc:2258] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:15.716425 914 tablet_replica.cc:330] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d: stopping tablet replica
I20260812 06:58:15.716610 914 raft_consensus.cc:2229] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:15.716871 914 raft_consensus.cc:2258] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:15.717868 916 ts_tablet_manager.cc:1905] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:15.719287 914 ts_tablet_manager.cc:1905] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:15.720177 913 ts_tablet_manager.cc:1918] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:15.720333 913 log.cc:1196] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/96666faacb854059b8f854c76f68deb3
I20260812 06:58:15.720821 913 ts_tablet_manager.cc:1939] T 96666faacb854059b8f854c76f68deb3 P 0e2ba71074d645408b63648bfafd122c: Deleting consensus metadata
I20260812 06:58:15.722484 31832 catalog_manager.cc:4841] TS 0e2ba71074d645408b63648bfafd122c (127.18.70.129:37567): tablet 96666faacb854059b8f854c76f68deb3 (table test-table [id=bb4f44caac1b496e8dedf557312df461]) successfully deleted
I20260812 06:58:15.725171 916 ts_tablet_manager.cc:1918] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:15.725307 916 log.cc:1196] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/96666faacb854059b8f854c76f68deb3
I20260812 06:58:15.725802 916 ts_tablet_manager.cc:1939] T 96666faacb854059b8f854c76f68deb3 P 258730b2e0564b759cb81826c6cb54c0: Deleting consensus metadata
I20260812 06:58:15.726953 31830 catalog_manager.cc:4841] TS 258730b2e0564b759cb81826c6cb54c0 (127.18.70.130:38021): tablet 96666faacb854059b8f854c76f68deb3 (table test-table [id=bb4f44caac1b496e8dedf557312df461]) successfully deleted
I20260812 06:58:15.728806 914 ts_tablet_manager.cc:1918] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:15.728912 914 log.cc:1196] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/96666faacb854059b8f854c76f68deb3
I20260812 06:58:15.729295 914 ts_tablet_manager.cc:1939] T 96666faacb854059b8f854c76f68deb3 P aee6353114354080b7ebeb966697632d: Deleting consensus metadata
I20260812 06:58:15.730187 31830 catalog_manager.cc:4841] TS aee6353114354080b7ebeb966697632d (127.18.70.131:35691): tablet 96666faacb854059b8f854c76f68deb3 (table test-table [id=bb4f44caac1b496e8dedf557312df461]) successfully deleted
I20260812 06:58:15.731283 832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.695100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46086 (local address 127.18.70.129:37567)
0812 06:58:15.695273 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:15.695280 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:15.710399 (+ 15119us) server_negotiation.cc:407] Connection header received
0812 06:58:15.710632 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:15.710637 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:15.710724 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:15.710823 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:15.713025 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.714176 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.716033 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.716667 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.716791 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.723980 (+ 7189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:15.723998 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:15.724020 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:15.724069 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:15.727878 (+ 3809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:15.728682 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:15.728692 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:15.728696 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:15.728934 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:15.729455 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:15.729460 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:15.729463 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:15.729955 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:15.730267 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:15.730679 (+ 412us) server_negotiation.cc:299] Negotiation successful
0812 06:58:15.730905 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 06:58:15.731915 32540 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:15.855134 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 32203
I20260812 06:58:15.877730 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 32579
I20260812 06:58:15.891754 887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:15.878485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49094 (local address 127.18.70.130:38021)
0812 06:58:15.878693 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:15.878700 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:15.878753 (+ 53us) server_negotiation.cc:407] Connection header received
0812 06:58:15.878958 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:15.878964 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:15.879033 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:15.879132 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:15.880468 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.881248 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.882568 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:15.883012 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:15.883130 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:15.885558 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:15.885571 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:15.885589 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:15.885619 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:15.888747 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:15.889403 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:15.889413 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:15.889416 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:15.889600 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:15.890053 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:15.890057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:15.890060 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:15.890500 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:15.890788 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:15.891107 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 06:58:15.891361 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 06:58:15.892510 377 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:16.009426 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 32579
I20260812 06:58:16.023236 922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:16.022540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50710)
0812 06:58:16.022969 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:16.023064 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":218,"threads_started":1}
I20260812 06:58:16.024524 922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:16.024210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41895 (local address 127.0.0.1:50722)
0812 06:58:16.024342 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:16.024413 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:41895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 06:58:16.043002 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 413
I20260812 06:58:16.055083 835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:16.043689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52752 (local address 127.18.70.131:35691)
0812 06:58:16.043871 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:16.043875 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:16.043893 (+ 18us) server_negotiation.cc:407] Connection header received
0812 06:58:16.044054 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:16.044057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:16.044120 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:16.044207 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:16.045446 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:16.046232 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:16.047310 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:16.047697 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:16.047781 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:16.050208 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:16.050219 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:16.050237 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:16.050263 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:16.052788 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:16.053333 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:16.053339 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:16.053341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:16.053468 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:16.053749 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:16.053751 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:16.053753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:16.054134 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:16.054366 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:16.054566 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 06:58:16.054757 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 06:58:16.055699 650 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:16.174997 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 413
I20260812 06:58:16.202946 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 31584
I20260812 06:58:16.204041 31919 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:16.324074 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 31584
I20260812 06:58:16.353827 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 31792
I20260812 06:58:16.354892 32291 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:16.468216 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 31792
2026-08-12T06:58:16Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10401 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:58:16 dist-test-slave-tc2s krb5kdc[935](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:58:16 dist-test-slave-tc2s krb5kdc[935](info): set up 2 sockets
Aug 12 06:58:16 dist-test-slave-tc2s krb5kdc[935](info): commencing operation
krb5kdc: starting...
W20260812 06:58:17.737308 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.002s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:58:17 dist-test-slave-tc2s krb5kdc[935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:58:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:58:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.190.keytab.
Entry for principal oryx/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.190.keytab.
I20260812 06:58:17.948848 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:38725
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.190.keytab
--principal=oryx/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:38725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:18.269119 958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:18.269403 958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:18.269500 958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:18.276502 958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:58:18.276600 958 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:58:18.276647 958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:18.276710 958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:18.276760 958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:58:18.276826 958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:58:18.286497 958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:38725
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.190.keytab
--principal=oryx/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:38725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:18.287715 958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:18.288951 958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:18.300716 973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:18.300771 981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:18.300685 976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:18.301306 958 server_base.cc:1034] running on GCE node
I20260812 06:58:18.302186 958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:18.303532 958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:18.304746 958 hybrid_clock.cc:648] HybridClock initialized: now 1786517898304684 us; error 32 us; skew 500 ppm
I20260812 06:58:18.305066 958 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:18 dist-test-slave-tc2s krb5kdc[935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517898, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:18.308038 958 init.cc:377] Logged in from keytab as oryx/127.18.70.190@KRBTEST.COM (short username oryx)
I20260812 06:58:18.309420 958 webserver.cc:460] Webserver started at http://127.18.70.190:46213/ using document root <none> and password file <none>
I20260812 06:58:18.310148 958 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:18.310250 958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:18.310561 958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:18.313458 958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "bdf43bc29b3f409384e825d9f80a89cb"
format_stamp: "Formatted at 2026-08-12 06:58:18 on dist-test-slave-tc2s"
server_key: "5f751d97a3fef4421f60d69573a6432f"
server_key_iv: "773add5a31f9616bd05aae03f8107025"
server_key_version: "encryptionkey@0"
I20260812 06:58:18.314278 958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "bdf43bc29b3f409384e825d9f80a89cb"
format_stamp: "Formatted at 2026-08-12 06:58:18 on dist-test-slave-tc2s"
server_key: "5f751d97a3fef4421f60d69573a6432f"
server_key_iv: "773add5a31f9616bd05aae03f8107025"
server_key_version: "encryptionkey@0"
I20260812 06:58:18.319304 958 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260812 06:58:18.322613 989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:18.323796 958 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 06:58:18.323957 958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "bdf43bc29b3f409384e825d9f80a89cb"
format_stamp: "Formatted at 2026-08-12 06:58:18 on dist-test-slave-tc2s"
server_key: "5f751d97a3fef4421f60d69573a6432f"
server_key_iv: "773add5a31f9616bd05aae03f8107025"
server_key_version: "encryptionkey@0"
I20260812 06:58:18.324149 958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:18.350215 958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:18.354023 958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:18.354266 958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:18.373646 958 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:38725
I20260812 06:58:18.373667 1099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:38725 every 8 connection(s)
I20260812 06:58:18.374938 958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:58:18.376307 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 958
I20260812 06:58:18.376514 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:58:18.377136 18714 external_mini_cluster.cc:1428] Setting key 755f37bd89d4de68354afcbf598c6905
I20260812 06:58:18.379048 1101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 06:58:18 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:18.391969 1101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb: Bootstrap starting.
I20260812 06:58:18.395305 1101 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:18.396327 1101 log.cc:824] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:18.399361 1110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:18.379025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37076 (local address 127.18.70.190:38725)
0812 06:58:18.379837 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:18.379848 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:18.379888 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:58:18.381508 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:18.381531 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:18.381928 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:18.382277 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:18.384019 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:18.385342 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:18.386997 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:18.387640 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:18.387765 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:18.392177 (+ 4412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:18.392186 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:18.392200 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:18.392235 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:18.395092 (+ 2857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:18.395827 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:18.395833 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:18.395839 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:18.396002 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:18.396350 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:18.396354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:18.396356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:18.396903 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:18.397195 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:18.397619 (+ 424us) server_negotiation.cc:299] Negotiation successful
0812 06:58:18.398076 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":375,"threads_started":1}
I20260812 06:58:18.400202 1101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb: No bootstrap required, opened a new log
I20260812 06:58:18.408535 1101 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf43bc29b3f409384e825d9f80a89cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38725 } }
I20260812 06:58:18.408916 1101 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:18.409010 1101 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf43bc29b3f409384e825d9f80a89cb, State: Initialized, Role: FOLLOWER
I20260812 06:58:18.409641 1101 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf43bc29b3f409384e825d9f80a89cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38725 } }
I20260812 06:58:18.409941 1101 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:58:18.410070 1101 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:58:18.410226 1101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:18.413089 1101 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf43bc29b3f409384e825d9f80a89cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38725 } }
I20260812 06:58:18.413652 1101 leader_election.cc:302] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdf43bc29b3f409384e825d9f80a89cb; no voters:
I20260812 06:58:18.414256 1101 leader_election.cc:288] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:58:18.414415 1113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:18.415530 1113 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [term 1 LEADER]: Becoming Leader. State: Replica: bdf43bc29b3f409384e825d9f80a89cb, State: Running, Role: LEADER
I20260812 06:58:18.416213 1113 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf43bc29b3f409384e825d9f80a89cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38725 } }
I20260812 06:58:18.416515 1101 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:58:18.418852 1114 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdf43bc29b3f409384e825d9f80a89cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf43bc29b3f409384e825d9f80a89cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38725 } } }
I20260812 06:58:18.419207 1114 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:18.421370 1115 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdf43bc29b3f409384e825d9f80a89cb. Latest consensus state: current_term: 1 leader_uuid: "bdf43bc29b3f409384e825d9f80a89cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf43bc29b3f409384e825d9f80a89cb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38725 } } }
I20260812 06:58:18.421711 1115 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:18.424199 1121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:58:18.430218 1121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:58:18.456533 1121 catalog_manager.cc:1347] Generated new cluster ID: 9e79a26e7ac44c4390b8065381df2239
I20260812 06:58:18.456704 1121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:58:18.468967 1121 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:58:18.470425 1121 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:58:18.475857 1121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb: Generated new TSK 0
I20260812 06:58:18.476593 1121 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab.
Entry for principal oryx/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab.
I20260812 06:58:18.535646 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:38725
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab
--principal=oryx/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:18.856129 1150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:18.856417 1150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:18.856568 1150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:18.863509 1150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:18.863616 1150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:18.863745 1150 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:58:18.863858 1150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:58:18.873131 1150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab
--principal=oryx/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.70.190:38725
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:18.874363 1150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:18.875663 1150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:18.887761 1157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:18.887741 1158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:18.887818 1163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:18.888695 1150 server_base.cc:1034] running on GCE node
I20260812 06:58:18.889227 1150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:18.890067 1150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:18.891266 1150 hybrid_clock.cc:648] HybridClock initialized: now 1786517898891209 us; error 33 us; skew 500 ppm
I20260812 06:58:18.891525 1150 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:18 dist-test-slave-tc2s krb5kdc[935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517898, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:18.894421 1150 init.cc:377] Logged in from keytab as oryx/127.18.70.129@KRBTEST.COM (short username oryx)
I20260812 06:58:18.895718 1150 webserver.cc:460] Webserver started at http://127.18.70.129:43291/ using document root <none> and password file <none>
I20260812 06:58:18.896431 1150 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:18.896554 1150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:18.896919 1150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:18.899897 1150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "aa6b2b30324c4180aad5a825ab602d65"
format_stamp: "Formatted at 2026-08-12 06:58:18 on dist-test-slave-tc2s"
server_key: "c3ed9676161afb1e292ebfdfc245e473"
server_key_iv: "6f4808e0a7c87a0cea33a7f2819aadc2"
server_key_version: "encryptionkey@0"
I20260812 06:58:18.900717 1150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "aa6b2b30324c4180aad5a825ab602d65"
format_stamp: "Formatted at 2026-08-12 06:58:18 on dist-test-slave-tc2s"
server_key: "c3ed9676161afb1e292ebfdfc245e473"
server_key_iv: "6f4808e0a7c87a0cea33a7f2819aadc2"
server_key_version: "encryptionkey@0"
I20260812 06:58:18.905527 1150 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260812 06:58:18.908730 1177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:18.909930 1150 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260812 06:58:18.910075 1150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "aa6b2b30324c4180aad5a825ab602d65"
format_stamp: "Formatted at 2026-08-12 06:58:18 on dist-test-slave-tc2s"
server_key: "c3ed9676161afb1e292ebfdfc245e473"
server_key_iv: "6f4808e0a7c87a0cea33a7f2819aadc2"
server_key_version: "encryptionkey@0"
I20260812 06:58:18.910271 1150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:18.926887 1150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:18.930560 1150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:18.930794 1150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:18.933214 1150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:18.933313 1150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:18.933436 1150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:18.933516 1150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:58:18 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517898, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:18.955157 1188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:18.933762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:35993 (local address 127.18.70.190:38725)
0812 06:58:18.934431 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:18.934435 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:18.935416 (+ 981us) server_negotiation.cc:407] Connection header received
0812 06:58:18.937356 (+ 1940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:18.937362 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:18.937449 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:18.937545 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:18.939652 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:18.940734 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:18.943095 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:18.943731 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:18.943869 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:18.948163 (+ 4294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:18.948169 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:18.948172 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:18.948204 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:18.951352 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:18.952252 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:18.952259 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:18.952261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:18.952419 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:18.953043 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:18.953049 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:18.953052 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:18.953384 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:18.953535 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:18.954551 (+ 1016us) server_negotiation.cc:299] Negotiation successful
0812 06:58:18.954787 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":476,"threads_started":1}
I20260812 06:58:18.956091 1189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:18.934457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38725 (local address 127.18.70.129:35993)
0812 06:58:18.935259 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:18.935296 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:18.937092 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:18.937822 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:18.937833 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:18.938615 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:18.939389 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:18.939412 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:18.940928 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:18.940934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:18.942945 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:18.942958 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:18.943950 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:18.943955 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:18.944126 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:18.944770 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:18.944792 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:18.947924 (+ 3132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:18.951510 (+ 3586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:18.951519 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:18.951538 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:18.952079 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:18.952552 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:18.952561 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:18.952565 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:18.952878 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:18.953627 (+ 749us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:18.953639 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:18.954096 (+ 457us) client_negotiation.cc:769] Sending connection context
0812 06:58:18.954438 (+ 342us) client_negotiation.cc:240] Negotiation successful
0812 06:58:18.954938 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":363,"threads_started":1}
I20260812 06:58:18.976068 1150 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:38665
I20260812 06:58:18.976121 1414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:38665 every 8 connection(s)
I20260812 06:58:18.977577 1150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:58:18.978222 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 1150
I20260812 06:58:18.978446 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:58:18.978547 1357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:18.964376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38725 (local address 127.18.70.129:57379)
0812 06:58:18.965003 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:18.965024 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:18.965172 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:18.965545 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:18.965550 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:18.966030 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:18.966394 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:18.966405 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:18.967780 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:18.967783 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:18.968934 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:18.968955 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:18.970018 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:18.970026 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:18.970217 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:18.970915 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:18.970938 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:18.972103 (+ 1165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:18.975814 (+ 3711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:18.975819 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:18.975823 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:18.976365 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:18.976746 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:18.976749 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:18.976751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:18.976864 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:18.977421 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:18.977424 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:18.977591 (+ 167us) client_negotiation.cc:769] Sending connection context
0812 06:58:18.977776 (+ 185us) client_negotiation.cc:240] Negotiation successful
0812 06:58:18.978094 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":322,"threads_started":1}
I20260812 06:58:18.978579 1188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:18.964303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:57379 (local address 127.18.70.190:38725)
0812 06:58:18.964494 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:18.964500 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:18.965109 (+ 609us) server_negotiation.cc:407] Connection header received
0812 06:58:18.965306 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:18.965312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:18.965395 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:18.965495 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:18.966548 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:18.967650 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:18.969084 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:18.969753 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:18.969931 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:18.972333 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:18.972340 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:18.972345 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:18.972383 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:18.975679 (+ 3296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:18.976476 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:18.976482 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:18.976486 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:18.976641 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:18.976963 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:18.976968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:18.976971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:18.977318 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:18.977466 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:18.978069 (+ 603us) server_negotiation.cc:299] Negotiation successful
0812 06:58:18.978285 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 06:58:18.979295 18714 external_mini_cluster.cc:1428] Setting key e9c7bc5c3c30d134030495f5e86fce59
I20260812 06:58:18.980264 1415 heartbeater.cc:347] Connected to a master server at 127.18.70.190:38725
I20260812 06:58:18.980779 1415 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:18.981585 1415 heartbeater.cc:511] Master 127.18.70.190:38725 requested a full tablet report, sending...
I20260812 06:58:18.983847 1021 ts_manager.cc:194] Registered new tserver with Master: aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129:38665)
I20260812 06:58:18.985213 1021 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:35993
WARNING: no policy specified for oryx/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab.
Entry for principal oryx/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab.
I20260812 06:58:19.024619 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:38725
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab
--principal=oryx/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:19.343806 1420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:19.344064 1420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:19.344170 1420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:19.351076 1420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:19.351171 1420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:19.351258 1420 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:58:19.351341 1420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:58:19.360598 1420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab
--principal=oryx/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.70.190:38725
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:19.361720 1420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:19.363013 1420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:19.375126 1426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:19.375310 1428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:19.375408 1432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:19.383277 1420 server_base.cc:1034] running on GCE node
I20260812 06:58:19.383832 1420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:19.384752 1420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:19.385998 1420 hybrid_clock.cc:648] HybridClock initialized: now 1786517899385942 us; error 31 us; skew 500 ppm
I20260812 06:58:19.386272 1420 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:19 dist-test-slave-tc2s krb5kdc[935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517899, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:19.389495 1420 init.cc:377] Logged in from keytab as oryx/127.18.70.130@KRBTEST.COM (short username oryx)
I20260812 06:58:19.391129 1420 webserver.cc:460] Webserver started at http://127.18.70.130:40273/ using document root <none> and password file <none>
I20260812 06:58:19.391966 1420 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:19.392071 1420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:19.392397 1420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:19.395330 1420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "373e647ae0154576aa605563267ff97b"
format_stamp: "Formatted at 2026-08-12 06:58:19 on dist-test-slave-tc2s"
server_key: "149db5f018e886f5da652570d7885e28"
server_key_iv: "6e710735cd71106ba82c4d6e47304b9a"
server_key_version: "encryptionkey@0"
I20260812 06:58:19.396051 1420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "373e647ae0154576aa605563267ff97b"
format_stamp: "Formatted at 2026-08-12 06:58:19 on dist-test-slave-tc2s"
server_key: "149db5f018e886f5da652570d7885e28"
server_key_iv: "6e710735cd71106ba82c4d6e47304b9a"
server_key_version: "encryptionkey@0"
I20260812 06:58:19.400816 1420 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260812 06:58:19.404116 1443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:19.405639 1420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 06:58:19.405791 1420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "373e647ae0154576aa605563267ff97b"
format_stamp: "Formatted at 2026-08-12 06:58:19 on dist-test-slave-tc2s"
server_key: "149db5f018e886f5da652570d7885e28"
server_key_iv: "6e710735cd71106ba82c4d6e47304b9a"
server_key_version: "encryptionkey@0"
I20260812 06:58:19.406054 1420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:19.431691 1420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:19.435343 1420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:19.435566 1420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:19.438035 1420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:19.438119 1420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:19.438242 1420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:19.438299 1420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:58:19 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517899, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:19.462595 1188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:19.438671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:38589 (local address 127.18.70.190:38725)
0812 06:58:19.438870 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:19.438877 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:19.440180 (+ 1303us) server_negotiation.cc:407] Connection header received
0812 06:58:19.442247 (+ 2067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:19.442254 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:19.442346 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:19.442469 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:19.444407 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.445512 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.447917 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.448619 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.448756 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:19.452959 (+ 4203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:19.452968 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:19.452973 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:19.453014 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:19.457103 (+ 4089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:19.458891 (+ 1788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:19.458897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:19.458901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:19.459072 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:19.459662 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:19.459667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:19.459670 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:19.460053 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:19.460206 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:19.461952 (+ 1746us) server_negotiation.cc:299] Negotiation successful
0812 06:58:19.462207 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 06:58:19.464064 1460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:19.439160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38725 (local address 127.18.70.130:38589)
0812 06:58:19.440008 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:19.440053 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:19.441960 (+ 1907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:19.442706 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:19.442714 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:19.443390 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:19.444183 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:19.444211 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.445707 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.445713 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:19.447767 (+ 2054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:19.447780 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.448870 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.448879 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:19.449083 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:19.449757 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:19.449778 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:19.452736 (+ 2958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:19.457238 (+ 4502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:19.457247 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:19.457262 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:19.457966 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:19.459219 (+ 1253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:19.459224 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:19.459227 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:19.459522 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:19.460210 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:19.460219 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:19.461035 (+ 816us) client_negotiation.cc:769] Sending connection context
0812 06:58:19.461571 (+ 536us) client_negotiation.cc:240] Negotiation successful
0812 06:58:19.462276 (+ 705us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":364,"threads_started":1}
I20260812 06:58:19.476015 1420 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:42495
I20260812 06:58:19.476066 1659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:42495 every 8 connection(s)
I20260812 06:58:19.477406 1420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:58:19.479764 1661 heartbeater.cc:347] Connected to a master server at 127.18.70.190:38725
I20260812 06:58:19.480001 1661 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:19.480613 1661 heartbeater.cc:511] Master 127.18.70.190:38725 requested a full tablet report, sending...
I20260812 06:58:19.481984 1021 ts_manager.cc:194] Registered new tserver with Master: 373e647ae0154576aa605563267ff97b (127.18.70.130:42495)
I20260812 06:58:19.483042 1021 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:38589
I20260812 06:58:19.484164 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 1420
I20260812 06:58:19.484359 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:58:19.484884 1641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:19.471162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38725 (local address 127.18.70.130:37643)
0812 06:58:19.471773 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:19.471794 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:19.471960 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:19.472324 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:19.472329 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:19.472994 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:19.473591 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:19.473611 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.474969 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.474974 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:19.476467 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:19.476480 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.477375 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.477382 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:19.477512 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:19.478129 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:19.478153 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:19.479211 (+ 1058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:19.482300 (+ 3089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:19.482305 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:19.482309 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:19.482789 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:19.483139 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:19.483143 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:19.483147 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:19.483297 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:19.483878 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:19.483883 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:19.484108 (+ 225us) client_negotiation.cc:769] Sending connection context
0812 06:58:19.484262 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 06:58:19.484563 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":317,"threads_started":1}
I20260812 06:58:19.484889 18714 external_mini_cluster.cc:1428] Setting key 3eb79fda32c2acdff04f0f5afda27402
I20260812 06:58:19.485610 1188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:19.471238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:37643 (local address 127.18.70.190:38725)
0812 06:58:19.471428 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:19.471435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:19.471874 (+ 439us) server_negotiation.cc:407] Connection header received
0812 06:58:19.472090 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:19.472097 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:19.472174 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:19.472278 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:19.473764 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.474818 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.476626 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.477213 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.477344 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:19.479379 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:19.479385 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:19.479390 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:19.479426 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:19.482184 (+ 2758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:19.482901 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:19.482904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:19.482906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:19.483035 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:19.483432 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:19.483438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:19.483441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:19.483759 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:19.483890 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:19.485186 (+ 1296us) server_negotiation.cc:299] Negotiation successful
0812 06:58:19.485343 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
WARNING: no policy specified for oryx/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab.
Entry for principal oryx/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab.
I20260812 06:58:19.530944 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:38725
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab
--principal=oryx/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:19.844834 1669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:19.845109 1669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:19.845247 1669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:19.852167 1669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:19.852274 1669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:19.852392 1669 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:58:19.852501 1669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:58:19.861936 1669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab
--principal=oryx/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.70.190:38725
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:19.863050 1669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:19.864296 1669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:19.876238 1676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:19.876269 1682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:19.876374 1679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:19.877338 1669 server_base.cc:1034] running on GCE node
I20260812 06:58:19.878003 1669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:19.878823 1669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:19.880033 1669 hybrid_clock.cc:648] HybridClock initialized: now 1786517899879973 us; error 41 us; skew 500 ppm
I20260812 06:58:19.880308 1669 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:19 dist-test-slave-tc2s krb5kdc[935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517899, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:19.883193 1669 init.cc:377] Logged in from keytab as oryx/127.18.70.131@KRBTEST.COM (short username oryx)
I20260812 06:58:19.884579 1669 webserver.cc:460] Webserver started at http://127.18.70.131:38821/ using document root <none> and password file <none>
I20260812 06:58:19.885203 1669 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:19.885299 1669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:19.885596 1669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:19.888345 1669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "deaf71fda6af4795b35902090772ea5d"
format_stamp: "Formatted at 2026-08-12 06:58:19 on dist-test-slave-tc2s"
server_key: "dbd5888fa5dceec38198c302fcc31fa0"
server_key_iv: "edde0beddd9ad9fd77e81d7159f117d5"
server_key_version: "encryptionkey@0"
I20260812 06:58:19.889108 1669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "deaf71fda6af4795b35902090772ea5d"
format_stamp: "Formatted at 2026-08-12 06:58:19 on dist-test-slave-tc2s"
server_key: "dbd5888fa5dceec38198c302fcc31fa0"
server_key_iv: "edde0beddd9ad9fd77e81d7159f117d5"
server_key_version: "encryptionkey@0"
I20260812 06:58:19.893761 1669 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260812 06:58:19.896970 1694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:19.898238 1669 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:58:19.898375 1669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "deaf71fda6af4795b35902090772ea5d"
format_stamp: "Formatted at 2026-08-12 06:58:19 on dist-test-slave-tc2s"
server_key: "dbd5888fa5dceec38198c302fcc31fa0"
server_key_iv: "edde0beddd9ad9fd77e81d7159f117d5"
server_key_version: "encryptionkey@0"
I20260812 06:58:19.898569 1669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:19.925372 1669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:19.929234 1669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:19.929481 1669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:19.932009 1669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:19.932091 1669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:19.932214 1669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:19.932283 1669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:58:19 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517899, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:19.953212 1188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:19.932532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:40805 (local address 127.18.70.190:38725)
0812 06:58:19.932726 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:19.932731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:19.934128 (+ 1397us) server_negotiation.cc:407] Connection header received
0812 06:58:19.936079 (+ 1951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:19.936086 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:19.936169 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:19.936254 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:19.938406 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.939579 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.941171 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.941802 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.941971 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:19.946285 (+ 4314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:19.946294 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:19.946299 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:19.946343 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:19.949230 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:19.950273 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:19.950280 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:19.950283 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:19.950441 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:19.950984 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:19.950989 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:19.950993 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:19.951355 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:19.951504 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:19.952535 (+ 1031us) server_negotiation.cc:299] Negotiation successful
0812 06:58:19.952808 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 06:58:19.953831 1705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:19.933115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38725 (local address 127.18.70.131:40805)
0812 06:58:19.933969 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:19.934012 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:19.935820 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:19.936538 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:19.936552 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:19.937345 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:19.938205 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:19.938229 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.939737 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.939742 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:19.941029 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:19.941042 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.942076 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.942086 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:19.942366 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:19.943005 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:19.943033 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:19.946072 (+ 3039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:19.949365 (+ 3293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:19.949374 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:19.949390 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:19.950126 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:19.950555 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:19.950560 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:19.950568 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:19.950866 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:19.951570 (+ 704us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:19.951576 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:19.952040 (+ 464us) client_negotiation.cc:769] Sending connection context
0812 06:58:19.952340 (+ 300us) client_negotiation.cc:240] Negotiation successful
0812 06:58:19.952780 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":335,"threads_started":1}
I20260812 06:58:19.973022 1188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:19.959247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:59681 (local address 127.18.70.190:38725)
0812 06:58:19.959406 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:19.959411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:19.960143 (+ 732us) server_negotiation.cc:407] Connection header received
0812 06:58:19.960330 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:19.960336 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:19.960420 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:19.960513 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:19.961943 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.962761 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.964983 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.965425 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.965517 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:19.967694 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:19.967699 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:19.967702 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:19.967730 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:19.970597 (+ 2867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:19.971186 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:19.971191 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:19.971195 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:19.971309 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:19.971647 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:19.971653 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:19.971656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:19.971933 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:19.972058 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:19.972459 (+ 401us) server_negotiation.cc:299] Negotiation successful
0812 06:58:19.972663 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:58:19.973085 1830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:19.959362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38725 (local address 127.18.70.131:59681)
0812 06:58:19.960048 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:19.960072 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:19.960203 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:19.960570 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:19.960578 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:19.961264 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:19.961760 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:19.961777 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.962896 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.962902 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:19.964813 (+ 1911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:19.964834 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:19.965616 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:19.965623 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:19.965787 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:19.966419 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:19.966452 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:19.967524 (+ 1072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:19.970704 (+ 3180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:19.970709 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:19.970713 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:19.971078 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:19.971419 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:19.971424 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:19.971428 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:19.971548 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:19.972045 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:19.972049 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:19.972215 (+ 166us) client_negotiation.cc:769] Sending connection context
0812 06:58:19.972341 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 06:58:19.972643 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":345,"threads_started":1}
I20260812 06:58:19.977928 1669 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:33875
I20260812 06:58:19.977964 1905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:33875 every 8 connection(s)
I20260812 06:58:19.979000 1669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:58:19.981232 1906 heartbeater.cc:347] Connected to a master server at 127.18.70.190:38725
I20260812 06:58:19.981462 1906 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:19.982093 1906 heartbeater.cc:511] Master 127.18.70.190:38725 requested a full tablet report, sending...
I20260812 06:58:19.983279 1024 ts_manager.cc:194] Registered new tserver with Master: deaf71fda6af4795b35902090772ea5d (127.18.70.131:33875)
I20260812 06:58:19.984090 1024 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:40805
I20260812 06:58:19.987615 1415 heartbeater.cc:503] Master 127.18.70.190:38725 was elected leader, sending a full tablet report...
I20260812 06:58:19.987962 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 1669
I20260812 06:58:19.988150 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:58:19.988556 18714 external_mini_cluster.cc:1428] Setting key f1ffa2a58ff6c4e9abb2e928d6e9358a
I20260812 06:58:19.991294 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:58:20 dist-test-slave-tc2s krb5kdc[935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517900, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:58:20 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:20 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:20.486111 1661 heartbeater.cc:503] Master 127.18.70.190:38725 was elected leader, sending a full tablet report...
I20260812 06:58:20.986205 1906 heartbeater.cc:503] Master 127.18.70.190:38725 was elected leader, sending a full tablet report...
W20260812 06:58:21.061807 1918 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.026s user 0.004s sys 0.011s
W20260812 06:58:21.063050 1188 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:20.030335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37086 (local address 127.18.70.190:38725)
0812 06:58:20.030552 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:20.030559 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:20.030793 (+ 234us) server_negotiation.cc:407] Connection header received
0812 06:58:20.030974 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:20.030980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:20.031065 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:20.031151 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:20.032448 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:20.033187 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:20.034457 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:20.034877 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:20.034999 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.062792 (+1027793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37086: BlockingRecv error: recv got EOF from 127.0.0.1:37086 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 12 06:58:21 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517900, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:21.084735 1188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.066212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37096 (local address 127.18.70.190:38725)
0812 06:58:21.066384 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.066388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.066743 (+ 355us) server_negotiation.cc:407] Connection header received
0812 06:58:21.066897 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.066902 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.067032 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.067137 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:21.068189 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.068913 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.070101 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.070512 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.070606 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.080150 (+ 9544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:21.080156 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:21.080160 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:21.080191 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:21.082665 (+ 2474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:21.083262 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:21.083266 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:21.083268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:21.083377 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:21.083692 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:21.083695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:21.083697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:21.083958 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:21.084183 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.084321 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.084498 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 06:58:21.088533 1024 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:58:21.095299 1024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:58:21.126139 1942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.106456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:38665 (local address 127.0.0.1:34386)
0812 06:58:21.115703 (+ 9247us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:21.115746 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:21.115950 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:21.119488 (+ 3538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:21.119492 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:21.119516 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:21.119808 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.119818 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.121301 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.121306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.123722 (+ 2416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.123733 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.125227 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.125233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.125405 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.125435 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 06:58:21.125494 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:58:21.125661 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8945,"mutex_wait_us":106,"thread_start_us":10622,"threads_started":1}
I20260812 06:58:21.126323 1945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.106749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34386 (local address 127.18.70.129:38665)
0812 06:58:21.118981 (+ 12232us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.118989 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.119017 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:58:21.119109 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.119117 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.119325 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.119488 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:21.119962 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.121132 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.123863 (+ 2731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.125001 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.125607 (+ 606us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.125793 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.125862 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.126054 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12071,"thread_start_us":11915,"threads_started":1}
I20260812 06:58:21.126472 1941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.108641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:42495 (local address 127.0.0.1:39258)
0812 06:58:21.117351 (+ 8710us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:21.117373 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:21.117490 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:21.118430 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:21.118438 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:21.118472 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:21.118953 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.118965 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.120822 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.120827 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.123456 (+ 2629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.123472 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.125533 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.125540 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.125689 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.125719 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 06:58:21.125839 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 06:58:21.126007 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8581,"mutex_wait_us":58,"thread_start_us":7451,"threads_started":1}
I20260812 06:58:21.126986 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.109278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39258 (local address 127.18.70.130:42495)
0812 06:58:21.117517 (+ 8239us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.117526 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.117556 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:58:21.117658 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.117666 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.117942 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.118395 (+ 453us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:21.119139 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.120688 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.123614 (+ 2926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.125324 (+ 1710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.125455 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.125647 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.126231 (+ 584us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.126434 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7581,"thread_start_us":7431,"threads_started":1}
I20260812 06:58:21.127115 1948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.106944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55504 (local address 127.18.70.131:33875)
0812 06:58:21.117861 (+ 10917us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.117869 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.117922 (+ 53us) server_negotiation.cc:407] Connection header received
0812 06:58:21.118019 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.118026 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.118227 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.118394 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:21.119323 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.120907 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.123416 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.124837 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.124996 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.125206 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.126730 (+ 1524us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.126874 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10767,"thread_start_us":11160,"threads_started":1}
I20260812 06:58:21.127866 1949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.106621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:33875 (local address 127.0.0.1:55504)
0812 06:58:21.116403 (+ 9782us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:21.116419 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:21.116529 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:21.118642 (+ 2113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:21.118647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:21.118673 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:21.119163 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.119176 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.121046 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.121050 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.123269 (+ 2219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.123285 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.125049 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.125055 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.125250 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.125304 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 06:58:21.125445 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 06:58:21.127508 (+ 2063us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9656,"mutex_wait_us":112,"thread_start_us":8643,"threads_started":1}
I20260812 06:58:21.130842 1780 tablet_service.cc:1467] Processing CreateTablet for tablet 9622909db7114cf59097867d73e67db2 (DEFAULT_TABLE table=test-table [id=c5be96fec33847dc85625806f6793792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:21.130689 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 9622909db7114cf59097867d73e67db2 (DEFAULT_TABLE table=test-table [id=c5be96fec33847dc85625806f6793792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:21.130689 1538 tablet_service.cc:1467] Processing CreateTablet for tablet 9622909db7114cf59097867d73e67db2 (DEFAULT_TABLE table=test-table [id=c5be96fec33847dc85625806f6793792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:21.131992 1780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9622909db7114cf59097867d73e67db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:21.132058 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9622909db7114cf59097867d73e67db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:21.132058 1538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9622909db7114cf59097867d73e67db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:21.142792 1952 tablet_bootstrap.cc:492] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: Bootstrap starting.
I20260812 06:58:21.146530 1952 tablet_bootstrap.cc:654] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:21.146603 1960 tablet_bootstrap.cc:492] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: Bootstrap starting.
I20260812 06:58:21.147962 1952 log.cc:824] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:21.150015 1957 tablet_bootstrap.cc:492] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: Bootstrap starting.
I20260812 06:58:21.150017 1960 tablet_bootstrap.cc:654] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:21.151180 1952 tablet_bootstrap.cc:492] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: No bootstrap required, opened a new log
I20260812 06:58:21.151451 1952 ts_tablet_manager.cc:1397] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 06:58:21.151254 1960 log.cc:824] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:21.152753 1957 tablet_bootstrap.cc:654] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:21.153667 1957 log.cc:824] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:21.156126 1957 tablet_bootstrap.cc:492] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: No bootstrap required, opened a new log
I20260812 06:58:21.156347 1957 ts_tablet_manager.cc:1397] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 06:58:21.160458 1960 tablet_bootstrap.cc:492] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: No bootstrap required, opened a new log
I20260812 06:58:21.160769 1960 ts_tablet_manager.cc:1397] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.009s
I20260812 06:58:21.161966 1952 raft_consensus.cc:348] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } }
I20260812 06:58:21.162412 1952 raft_consensus.cc:374] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:21.162513 1952 raft_consensus.cc:729] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deaf71fda6af4795b35902090772ea5d, State: Initialized, Role: FOLLOWER
I20260812 06:58:21.163149 1952 consensus_queue.cc:260] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } }
I20260812 06:58:21.164371 1957 raft_consensus.cc:348] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } }
I20260812 06:58:21.164681 1957 raft_consensus.cc:374] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:21.164775 1957 raft_consensus.cc:729] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 373e647ae0154576aa605563267ff97b, State: Initialized, Role: FOLLOWER
I20260812 06:58:21.165278 1957 consensus_queue.cc:260] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } }
I20260812 06:58:21.166216 1952 ts_tablet_manager.cc:1428] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
I20260812 06:58:21.167706 1957 ts_tablet_manager.cc:1428] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260812 06:58:21.170244 1960 raft_consensus.cc:348] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } }
I20260812 06:58:21.170668 1960 raft_consensus.cc:374] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:21.170782 1960 raft_consensus.cc:729] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6b2b30324c4180aad5a825ab602d65, State: Initialized, Role: FOLLOWER
I20260812 06:58:21.171346 1960 consensus_queue.cc:260] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } }
I20260812 06:58:21.172851 1960 ts_tablet_manager.cc:1428] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: Time spent starting tablet: real 0.012s user 0.008s sys 0.003s
W20260812 06:58:21.230376 1662 tablet.cc:2369] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:58:21.231105 1416 tablet.cc:2369] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:58:21.231276 1907 tablet.cc:2369] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:58:21.238268 1972 raft_consensus.cc:482] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:58:21.238531 1972 raft_consensus.cc:504] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } }
I20260812 06:58:21.240087 1972 leader_election.cc:288] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers deaf71fda6af4795b35902090772ea5d (127.18.70.131:33875), 373e647ae0154576aa605563267ff97b (127.18.70.130:42495)
I20260812 06:58:21.248893 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.240495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:52153 (local address 127.18.70.130:42495)
0812 06:58:21.240719 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.240726 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.241412 (+ 686us) server_negotiation.cc:407] Connection header received
0812 06:58:21.241621 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.241625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.241687 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.241760 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:21.242457 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.243566 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.246584 (+ 3018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.247774 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.247927 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.248004 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.248510 (+ 506us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.248640 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 06:58:21.248893 1948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.240488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:44361 (local address 127.18.70.131:33875)
0812 06:58:21.240713 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.240720 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.241406 (+ 686us) server_negotiation.cc:407] Connection header received
0812 06:58:21.241620 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.241624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.241683 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.241758 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:21.242522 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.243574 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.246584 (+ 3010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.247774 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.247927 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.248004 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.248510 (+ 506us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.248640 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 06:58:21.249163 1973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.240329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:42495 (local address 127.18.70.129:52153)
0812 06:58:21.241315 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:21.241330 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:21.241487 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:21.241789 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:21.241794 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:21.241823 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:21.242297 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.242316 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.243700 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.243705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.246441 (+ 2736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.246451 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.248048 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.248053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.248306 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.248384 (+ 78us) client_negotiation.cc:769] Sending connection context
0812 06:58:21.248468 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 06:58:21.248669 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":888,"mutex_wait_us":330,"spinlock_wait_cycles":10880,"thread_start_us":538,"threads_started":1}
I20260812 06:58:21.249178 1974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.240327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:33875 (local address 127.18.70.129:44361)
0812 06:58:21.241295 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:21.241314 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:21.241486 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:21.241786 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:21.241797 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:21.241833 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:21.242329 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.242346 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.243703 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.243708 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.246434 (+ 2726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.246451 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.248030 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.248037 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.248302 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.248378 (+ 76us) client_negotiation.cc:769] Sending connection context
0812 06:58:21.248471 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 06:58:21.248669 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"mutex_wait_us":235,"spinlock_wait_cycles":52096,"thread_start_us":624,"threads_started":1}
I20260812 06:58:21.250173 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9622909db7114cf59097867d73e67db2" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deaf71fda6af4795b35902090772ea5d" is_pre_election: true
I20260812 06:58:21.250168 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9622909db7114cf59097867d73e67db2" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e647ae0154576aa605563267ff97b" is_pre_election: true
I20260812 06:58:21.250644 1823 raft_consensus.cc:2454] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 0.
I20260812 06:58:21.250644 1567 raft_consensus.cc:2454] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 0.
I20260812 06:58:21.251212 1179 leader_election.cc:302] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 373e647ae0154576aa605563267ff97b, aa6b2b30324c4180aad5a825ab602d65; no voters:
I20260812 06:58:21.251590 1972 raft_consensus.cc:2781] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:58:21.251715 1972 raft_consensus.cc:482] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:58:21.251814 1972 raft_consensus.cc:3037] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:21.254108 1972 raft_consensus.cc:504] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } }
I20260812 06:58:21.254689 1972 leader_election.cc:288] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 election: Requested vote from peers deaf71fda6af4795b35902090772ea5d (127.18.70.131:33875), 373e647ae0154576aa605563267ff97b (127.18.70.130:42495)
I20260812 06:58:21.255108 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9622909db7114cf59097867d73e67db2" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e647ae0154576aa605563267ff97b"
I20260812 06:58:21.255112 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9622909db7114cf59097867d73e67db2" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deaf71fda6af4795b35902090772ea5d"
I20260812 06:58:21.255290 1567 raft_consensus.cc:3037] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:21.255304 1823 raft_consensus.cc:3037] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:21.257481 1567 raft_consensus.cc:2454] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 1.
I20260812 06:58:21.257547 1823 raft_consensus.cc:2454] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 1.
I20260812 06:58:21.257834 1179 leader_election.cc:302] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 373e647ae0154576aa605563267ff97b, aa6b2b30324c4180aad5a825ab602d65; no voters:
I20260812 06:58:21.258129 1972 raft_consensus.cc:2781] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:21.258569 1972 raft_consensus.cc:686] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 1 LEADER]: Becoming Leader. State: Replica: aa6b2b30324c4180aad5a825ab602d65, State: Running, Role: LEADER
I20260812 06:58:21.259079 1972 consensus_queue.cc:237] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } }
I20260812 06:58:21.263383 1024 catalog_manager.cc:5495] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129). New cstate: current_term: 1 leader_uuid: "aa6b2b30324c4180aad5a825ab602d65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } health_report { overall_health: UNKNOWN } } }
I20260812 06:58:21.283885 1945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.278699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34388 (local address 127.18.70.129:38665)
0812 06:58:21.278910 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.278916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.278998 (+ 82us) server_negotiation.cc:407] Connection header received
0812 06:58:21.279214 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.279218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.279307 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.279442 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:58:21.279791 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.280514 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.281822 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.282267 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.282384 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.282795 (+ 411us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:58:21.283326 (+ 531us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:58:21.283466 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.283555 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.283635 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 06:58:21.291482 1567 raft_consensus.cc:1261] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Refusing update from remote peer aa6b2b30324c4180aad5a825ab602d65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:21.291481 1823 raft_consensus.cc:1261] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Refusing update from remote peer aa6b2b30324c4180aad5a825ab602d65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:21.292400 1972 consensus_queue.cc:1035] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:21.292667 1976 consensus_queue.cc:1035] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:21.302982 1988 mvcc.cc:205] Tried to move back new op lower bound from 7317577323680579584 to 7317577323560747008. Current Snapshot: MvccSnapshot[applied={T|T < 7317577323680579584}]
I20260812 06:58:21.306563 1992 mvcc.cc:205] Tried to move back new op lower bound from 7317577323680579584 to 7317577323560747008. Current Snapshot: MvccSnapshot[applied={T|T < 7317577323680579584}]
I20260812 06:58:21.316349 1024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:21.316610 1024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:21.319810 1024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb: Sending DeleteTablet for 3 replicas of tablet 9622909db7114cf59097867d73e67db2
I20260812 06:58:21.320956 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 9622909db7114cf59097867d73e67db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:21 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:34386
I20260812 06:58:21.320936 1780 tablet_service.cc:1514] Processing DeleteTablet for tablet 9622909db7114cf59097867d73e67db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:21 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:55504
I20260812 06:58:21.320971 1538 tablet_service.cc:1514] Processing DeleteTablet for tablet 9622909db7114cf59097867d73e67db2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:21 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:39258
I20260812 06:58:21.324221 1021 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:58:21.324929 1021 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:58:21.333736 1778 tablet_service.cc:1467] Processing CreateTablet for tablet a83d521105a74b8ab655bb767824a744 (DEFAULT_TABLE table=test-table [id=24c6c2de063d48dabea28404a3a3eae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:21.334438 1778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a83d521105a74b8ab655bb767824a744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:21.335292 2012 tablet_replica.cc:330] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: stopping tablet replica
I20260812 06:58:21.335757 2012 raft_consensus.cc:2229] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:58:21.336400 2012 raft_consensus.cc:2258] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:21.338878 1536 tablet_service.cc:1467] Processing CreateTablet for tablet a83d521105a74b8ab655bb767824a744 (DEFAULT_TABLE table=test-table [id=24c6c2de063d48dabea28404a3a3eae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:21.339493 1536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a83d521105a74b8ab655bb767824a744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:21.340658 2012 ts_tablet_manager.cc:1905] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:21.343171 1280 tablet_service.cc:1467] Processing CreateTablet for tablet a83d521105a74b8ab655bb767824a744 (DEFAULT_TABLE table=test-table [id=24c6c2de063d48dabea28404a3a3eae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:21.343691 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a83d521105a74b8ab655bb767824a744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:21.349858 2015 tablet_replica.cc:330] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: stopping tablet replica
I20260812 06:58:21.350356 2015 raft_consensus.cc:2229] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:21.350457 1960 tablet_bootstrap.cc:492] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65: Bootstrap starting.
I20260812 06:58:21.350903 2015 raft_consensus.cc:2258] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:21.352138 1960 tablet_bootstrap.cc:654] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:21.353078 2015 ts_tablet_manager.cc:1905] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:21.354027 1957 tablet_bootstrap.cc:492] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b: Bootstrap starting.
I20260812 06:58:21.355343 2012 ts_tablet_manager.cc:1918] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:21.355516 2012 log.cc:1196] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/9622909db7114cf59097867d73e67db2
I20260812 06:58:21.355654 1957 tablet_bootstrap.cc:654] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:21.356077 2012 ts_tablet_manager.cc:1939] T 9622909db7114cf59097867d73e67db2 P aa6b2b30324c4180aad5a825ab602d65: Deleting consensus metadata
I20260812 06:58:21.359090 1960 tablet_bootstrap.cc:492] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65: No bootstrap required, opened a new log
I20260812 06:58:21.359306 1960 ts_tablet_manager.cc:1397] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260812 06:58:21.360226 1960 raft_consensus.cc:348] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.360598 1952 tablet_bootstrap.cc:492] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d: Bootstrap starting.
I20260812 06:58:21.360594 1960 raft_consensus.cc:374] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:21.360802 1960 raft_consensus.cc:729] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6b2b30324c4180aad5a825ab602d65, State: Initialized, Role: FOLLOWER
I20260812 06:58:21.361157 1960 consensus_queue.cc:260] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.362334 1952 tablet_bootstrap.cc:654] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:21.364887 1960 ts_tablet_manager.cc:1428] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260812 06:58:21.366539 990 catalog_manager.cc:4841] TS aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129:38665): tablet 9622909db7114cf59097867d73e67db2 (table test-table [id=c5be96fec33847dc85625806f6793792]) successfully deleted
I20260812 06:58:21.370925 2015 ts_tablet_manager.cc:1918] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:21.371126 2015 log.cc:1196] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/9622909db7114cf59097867d73e67db2
I20260812 06:58:21.371706 2015 ts_tablet_manager.cc:1939] T 9622909db7114cf59097867d73e67db2 P 373e647ae0154576aa605563267ff97b: Deleting consensus metadata
I20260812 06:58:21.373529 992 catalog_manager.cc:4841] TS 373e647ae0154576aa605563267ff97b (127.18.70.130:42495): tablet 9622909db7114cf59097867d73e67db2 (table test-table [id=c5be96fec33847dc85625806f6793792]) successfully deleted
I20260812 06:58:21.378907 2011 tablet_replica.cc:330] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: stopping tablet replica
I20260812 06:58:21.379118 1952 tablet_bootstrap.cc:492] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d: No bootstrap required, opened a new log
I20260812 06:58:21.379307 1952 ts_tablet_manager.cc:1397] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.008s
I20260812 06:58:21.379437 2011 raft_consensus.cc:2229] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:21.379989 2011 raft_consensus.cc:2258] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:21.380272 1952 raft_consensus.cc:348] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.380761 1952 raft_consensus.cc:374] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:21.380908 1952 raft_consensus.cc:729] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deaf71fda6af4795b35902090772ea5d, State: Initialized, Role: FOLLOWER
I20260812 06:58:21.381366 1957 tablet_bootstrap.cc:492] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b: No bootstrap required, opened a new log
I20260812 06:58:21.381556 1957 ts_tablet_manager.cc:1397] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.002s
I20260812 06:58:21.382385 1957 raft_consensus.cc:348] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.382642 1957 raft_consensus.cc:374] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:21.381294 1952 consensus_queue.cc:260] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.382766 1957 raft_consensus.cc:729] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 373e647ae0154576aa605563267ff97b, State: Initialized, Role: FOLLOWER
I20260812 06:58:21.383044 1957 consensus_queue.cc:260] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.383644 1957 ts_tablet_manager.cc:1428] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:58:21.385586 1952 ts_tablet_manager.cc:1428] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260812 06:58:21.386461 2011 ts_tablet_manager.cc:1905] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:21.391762 2011 ts_tablet_manager.cc:1918] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:21.391901 2011 log.cc:1196] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/9622909db7114cf59097867d73e67db2
I20260812 06:58:21.392319 2011 ts_tablet_manager.cc:1939] T 9622909db7114cf59097867d73e67db2 P deaf71fda6af4795b35902090772ea5d: Deleting consensus metadata
I20260812 06:58:21.393685 996 catalog_manager.cc:4841] TS deaf71fda6af4795b35902090772ea5d (127.18.70.131:33875): tablet 9622909db7114cf59097867d73e67db2 (table test-table [id=c5be96fec33847dc85625806f6793792]) successfully deleted
I20260812 06:58:21.620790 1995 raft_consensus.cc:482] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:58:21.621091 1995 raft_consensus.cc:504] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.622170 1995 leader_election.cc:288] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 373e647ae0154576aa605563267ff97b (127.18.70.130:42495), deaf71fda6af4795b35902090772ea5d (127.18.70.131:33875)
I20260812 06:58:21.622737 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a83d521105a74b8ab655bb767824a744" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deaf71fda6af4795b35902090772ea5d" is_pre_election: true
I20260812 06:58:21.622795 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a83d521105a74b8ab655bb767824a744" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e647ae0154576aa605563267ff97b" is_pre_election: true
I20260812 06:58:21.622985 1823 raft_consensus.cc:2454] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 0.
I20260812 06:58:21.623087 1567 raft_consensus.cc:2454] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 0.
I20260812 06:58:21.623514 1182 leader_election.cc:302] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa6b2b30324c4180aad5a825ab602d65, deaf71fda6af4795b35902090772ea5d; no voters:
I20260812 06:58:21.623814 1995 raft_consensus.cc:2781] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:58:21.623934 1995 raft_consensus.cc:482] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:58:21.624028 1995 raft_consensus.cc:3037] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:21.626588 1995 raft_consensus.cc:504] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.627394 1995 leader_election.cc:288] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 election: Requested vote from peers 373e647ae0154576aa605563267ff97b (127.18.70.130:42495), deaf71fda6af4795b35902090772ea5d (127.18.70.131:33875)
I20260812 06:58:21.627800 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a83d521105a74b8ab655bb767824a744" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e647ae0154576aa605563267ff97b"
I20260812 06:58:21.627913 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a83d521105a74b8ab655bb767824a744" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deaf71fda6af4795b35902090772ea5d"
I20260812 06:58:21.628014 1567 raft_consensus.cc:3037] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:21.628114 1823 raft_consensus.cc:3037] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:21.630975 1823 raft_consensus.cc:2454] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 1.
I20260812 06:58:21.630967 1567 raft_consensus.cc:2454] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 1.
I20260812 06:58:21.631405 1179 leader_election.cc:302] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 373e647ae0154576aa605563267ff97b, aa6b2b30324c4180aad5a825ab602d65; no voters:
I20260812 06:58:21.631820 1995 raft_consensus.cc:2781] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:21.631949 1995 raft_consensus.cc:686] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 1 LEADER]: Becoming Leader. State: Replica: aa6b2b30324c4180aad5a825ab602d65, State: Running, Role: LEADER
I20260812 06:58:21.632232 1995 consensus_queue.cc:237] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.634930 1024 catalog_manager.cc:5495] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129). New cstate: current_term: 1 leader_uuid: "aa6b2b30324c4180aad5a825ab602d65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } health_report { overall_health: UNKNOWN } } }
Aug 12 06:58:21 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517898, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.190@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:21.679558 2033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.664107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38725 (local address 127.0.0.1:37098)
0812 06:58:21.664854 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:21.664881 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:21.665074 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:21.665397 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:21.665401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:21.666469 (+ 1068us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:21.666711 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.666725 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.667805 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.667811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.669314 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.669332 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.670036 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.670042 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.670228 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.670898 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:21.670933 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:21.673424 (+ 2491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:21.677153 (+ 3729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:21.677164 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:21.677170 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:21.677573 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:21.678008 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:21.678012 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:21.678014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:21.678151 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:21.678794 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:21.678800 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:21.678938 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 06:58:21.679068 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 06:58:21.679258 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":352,"threads_started":1}
I20260812 06:58:21.679869 2034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.664175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37098 (local address 127.18.70.190:38725)
0812 06:58:21.665086 (+ 911us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.665090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.665111 (+ 21us) server_negotiation.cc:407] Connection header received
0812 06:58:21.665174 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.665177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.665237 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.665315 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:21.666859 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.667666 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.669456 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.669850 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.669980 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.673632 (+ 3652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:21.673638 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:21.673643 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:21.673679 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:21.676998 (+ 3319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:21.677697 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:21.677704 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:21.677707 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:21.677870 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:21.678265 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:21.678270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:21.678274 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:21.678667 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:21.678821 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.679220 (+ 399us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.679449 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":816,"thread_start_us":689,"threads_started":1}
I20260812 06:58:21.684569 1024 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:37098:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:58:21.685539 1024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:58:21.692132 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 14e83ad1f56f4d188d8464ff3e6aae02 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1a47852af0ae442a8710f77c73127398]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:58:21.692261 1536 tablet_service.cc:1467] Processing CreateTablet for tablet 14e83ad1f56f4d188d8464ff3e6aae02 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1a47852af0ae442a8710f77c73127398]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:58:21.692695 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14e83ad1f56f4d188d8464ff3e6aae02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:21.692809 1536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14e83ad1f56f4d188d8464ff3e6aae02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:21.698468 1957 tablet_bootstrap.cc:492] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b: Bootstrap starting.
I20260812 06:58:21.698719 1780 tablet_service.cc:1467] Processing CreateTablet for tablet 14e83ad1f56f4d188d8464ff3e6aae02 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1a47852af0ae442a8710f77c73127398]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:58:21.699297 1780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14e83ad1f56f4d188d8464ff3e6aae02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:21.700033 1960 tablet_bootstrap.cc:492] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65: Bootstrap starting.
I20260812 06:58:21.700133 1957 tablet_bootstrap.cc:654] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:21.702234 1960 tablet_bootstrap.cc:654] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:21.707263 1952 tablet_bootstrap.cc:492] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: Bootstrap starting.
I20260812 06:58:21.708910 1952 tablet_bootstrap.cc:654] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:21.709815 1960 tablet_bootstrap.cc:492] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65: No bootstrap required, opened a new log
I20260812 06:58:21.710076 1960 ts_tablet_manager.cc:1397] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.001s
I20260812 06:58:21.710866 1960 raft_consensus.cc:348] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.711197 1960 raft_consensus.cc:374] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:21.711350 1960 raft_consensus.cc:729] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6b2b30324c4180aad5a825ab602d65, State: Initialized, Role: FOLLOWER
I20260812 06:58:21.711680 1960 consensus_queue.cc:260] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.712186 1995 tablet_replica.cc:439] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } }
I20260812 06:58:21.712450 1995 tablet_replica.cc:442] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:58:21.715446 1960 ts_tablet_manager.cc:1428] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260812 06:58:21.716174 1957 tablet_bootstrap.cc:492] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b: No bootstrap required, opened a new log
I20260812 06:58:21.717386 1957 ts_tablet_manager.cc:1397] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.008s
I20260812 06:58:21.718225 1957 raft_consensus.cc:348] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.718492 1957 raft_consensus.cc:374] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:21.718569 1957 raft_consensus.cc:729] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 373e647ae0154576aa605563267ff97b, State: Initialized, Role: FOLLOWER
I20260812 06:58:21.718820 1957 consensus_queue.cc:260] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.719471 1957 ts_tablet_manager.cc:1428] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:58:21.719329 1971 tablet_replica.cc:439] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } }
I20260812 06:58:21.719727 1971 tablet_replica.cc:442] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:58:21.720911 1952 tablet_bootstrap.cc:492] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: No bootstrap required, opened a new log
I20260812 06:58:21.721063 1952 ts_tablet_manager.cc:1397] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.008s
I20260812 06:58:21.721661 1952 raft_consensus.cc:348] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.721938 1952 raft_consensus.cc:374] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:21.722028 1952 raft_consensus.cc:729] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deaf71fda6af4795b35902090772ea5d, State: Initialized, Role: FOLLOWER
I20260812 06:58:21.722259 1952 consensus_queue.cc:260] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.722846 1952 ts_tablet_manager.cc:1428] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:58:21.722776 1970 tablet_replica.cc:439] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } }
I20260812 06:58:21.723125 1970 tablet_replica.cc:442] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:58:21.752578 1970 raft_consensus.cc:482] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:58:21.752743 1970 raft_consensus.cc:504] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.754113 1970 leader_election.cc:288] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129:38665), 373e647ae0154576aa605563267ff97b (127.18.70.130:42495)
I20260812 06:58:21.760162 1945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.754380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:60911 (local address 127.18.70.129:38665)
0812 06:58:21.754567 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.754574 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.755045 (+ 471us) server_negotiation.cc:407] Connection header received
0812 06:58:21.755328 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.755333 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.755411 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.755486 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:21.756106 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.756858 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.758619 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.759333 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.759483 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.759557 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.759779 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.759899 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 06:58:21.760377 2038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.754332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:38665 (local address 127.18.70.131:60911)
0812 06:58:21.754942 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:21.754964 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:21.755163 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:21.755650 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:21.755653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:21.755674 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:21.755951 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.755960 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.756987 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.756991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.758456 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.758473 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.759484 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.759490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.759639 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.759663 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 06:58:21.759745 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 06:58:21.759868 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":2,"thread_start_us":371,"threads_started":1}
I20260812 06:58:21.760780 2039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.754380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:42495 (local address 127.18.70.131:41345)
0812 06:58:21.755489 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:21.755506 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:21.755622 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:21.755929 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:21.755937 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:21.755960 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:21.756275 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.756304 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.757378 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.757384 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.758913 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.758926 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.760031 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.760038 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.760175 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.760197 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 06:58:21.760299 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 06:58:21.760413 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1005,"mutex_wait_us":24,"thread_start_us":826,"threads_started":1}
I20260812 06:58:21.760784 2043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.754500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:41345 (local address 127.18.70.130:42495)
0812 06:58:21.755242 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.755249 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.755583 (+ 334us) server_negotiation.cc:407] Connection header received
0812 06:58:21.755747 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.755750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.755809 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.755887 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:21.756453 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.757227 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.759054 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.759796 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.759957 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.760035 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.760406 (+ 371us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.760552 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":496,"threads_started":1}
I20260812 06:58:21.761202 1315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e83ad1f56f4d188d8464ff3e6aae02" candidate_uuid: "deaf71fda6af4795b35902090772ea5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6b2b30324c4180aad5a825ab602d65" is_pre_election: true
I20260812 06:58:21.761394 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e83ad1f56f4d188d8464ff3e6aae02" candidate_uuid: "deaf71fda6af4795b35902090772ea5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e647ae0154576aa605563267ff97b" is_pre_election: true
I20260812 06:58:21.761529 1315 raft_consensus.cc:2454] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deaf71fda6af4795b35902090772ea5d in term 0.
I20260812 06:58:21.761667 1567 raft_consensus.cc:2454] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deaf71fda6af4795b35902090772ea5d in term 0.
I20260812 06:58:21.762111 1695 leader_election.cc:302] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa6b2b30324c4180aad5a825ab602d65, deaf71fda6af4795b35902090772ea5d; no voters:
I20260812 06:58:21.762485 1970 raft_consensus.cc:2781] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:58:21.762605 1970 raft_consensus.cc:482] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:58:21.762712 1970 raft_consensus.cc:3037] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:21.764869 1970 raft_consensus.cc:504] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.765385 1970 leader_election.cc:288] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [CANDIDATE]: Term 1 election: Requested vote from peers aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129:38665), 373e647ae0154576aa605563267ff97b (127.18.70.130:42495)
I20260812 06:58:21.765763 1315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e83ad1f56f4d188d8464ff3e6aae02" candidate_uuid: "deaf71fda6af4795b35902090772ea5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6b2b30324c4180aad5a825ab602d65"
I20260812 06:58:21.765853 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e83ad1f56f4d188d8464ff3e6aae02" candidate_uuid: "deaf71fda6af4795b35902090772ea5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e647ae0154576aa605563267ff97b"
I20260812 06:58:21.766038 1315 raft_consensus.cc:3037] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:21.766086 1567 raft_consensus.cc:3037] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:21.768946 1567 raft_consensus.cc:2454] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deaf71fda6af4795b35902090772ea5d in term 1.
I20260812 06:58:21.768970 1315 raft_consensus.cc:2454] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deaf71fda6af4795b35902090772ea5d in term 1.
I20260812 06:58:21.769341 1695 leader_election.cc:302] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa6b2b30324c4180aad5a825ab602d65, deaf71fda6af4795b35902090772ea5d; no voters:
I20260812 06:58:21.769606 1970 raft_consensus.cc:2781] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:21.770038 1970 raft_consensus.cc:686] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [term 1 LEADER]: Becoming Leader. State: Replica: deaf71fda6af4795b35902090772ea5d, State: Running, Role: LEADER
I20260812 06:58:21.770404 1970 consensus_queue.cc:237] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:21.772109 2044 tablet_replica.cc:439] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: TxnStatusTablet state changed. Reason: New leader deaf71fda6af4795b35902090772ea5d. Latest consensus state: current_term: 1 leader_uuid: "deaf71fda6af4795b35902090772ea5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } }
I20260812 06:58:21.772516 2044 tablet_replica.cc:442] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:58:21.773142 2048 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:58:21.773370 2048 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:58:21.773777 1021 catalog_manager.cc:5495] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d reported cstate change: term changed from 0 to 1, leader changed from <none> to deaf71fda6af4795b35902090772ea5d (127.18.70.131). New cstate: current_term: 1 leader_uuid: "deaf71fda6af4795b35902090772ea5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } health_report { overall_health: HEALTHY } } }
I20260812 06:58:21.790346 2033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.784492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:33875 (local address 127.0.0.1:55514)
0812 06:58:21.784728 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:21.784747 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:21.784847 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:21.785626 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:21.785631 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:21.785644 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:58:21.785833 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.785846 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.787019 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.787025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.787997 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.788010 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.788719 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.788725 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.788884 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.788935 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:58:21.789784 (+ 849us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:58:21.789812 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 06:58:21.789908 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 06:58:21.790062 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 06:58:21.790378 2053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.784695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55514 (local address 127.18.70.131:33875)
0812 06:58:21.785294 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.785298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.785315 (+ 17us) server_negotiation.cc:407] Connection header received
0812 06:58:21.785381 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.785385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.785456 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.785585 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:58:21.786001 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.786879 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.788132 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.788581 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.788688 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.789143 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:58:21.789678 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:58:21.789804 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.789936 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.790008 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":359,"threads_started":1}
I20260812 06:58:21.794037 1567 raft_consensus.cc:1261] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Refusing update from remote peer deaf71fda6af4795b35902090772ea5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:21.794332 1315 raft_consensus.cc:1261] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Refusing update from remote peer deaf71fda6af4795b35902090772ea5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:21.794687 2044 consensus_queue.cc:1035] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:21.795043 1970 consensus_queue.cc:1035] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:21.797847 1995 tablet_replica.cc:439] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65: TxnStatusTablet state changed. Reason: New leader deaf71fda6af4795b35902090772ea5d. Latest consensus state: current_term: 1 leader_uuid: "deaf71fda6af4795b35902090772ea5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } }
I20260812 06:58:21.798144 1995 tablet_replica.cc:442] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:58:21.798519 1971 tablet_replica.cc:439] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b: TxnStatusTablet state changed. Reason: New leader deaf71fda6af4795b35902090772ea5d. Latest consensus state: current_term: 1 leader_uuid: "deaf71fda6af4795b35902090772ea5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } }
I20260812 06:58:21.798812 1971 tablet_replica.cc:442] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:58:21.802050 2044 tablet_replica.cc:439] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "deaf71fda6af4795b35902090772ea5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } }
I20260812 06:58:21.802314 2044 tablet_replica.cc:442] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:58:21.803200 1995 tablet_replica.cc:439] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "deaf71fda6af4795b35902090772ea5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } }
I20260812 06:58:21.803126 2058 tablet_replica.cc:439] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "deaf71fda6af4795b35902090772ea5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } }
I20260812 06:58:21.803450 1995 tablet_replica.cc:442] T 14e83ad1f56f4d188d8464ff3e6aae02 P aa6b2b30324c4180aad5a825ab602d65: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:58:21.803505 2058 tablet_replica.cc:442] T 14e83ad1f56f4d188d8464ff3e6aae02 P deaf71fda6af4795b35902090772ea5d: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:58:21.805737 1990 mvcc.cc:205] Tried to move back new op lower bound from 7317577325741928448 to 7317577325654556672. Current Snapshot: MvccSnapshot[applied={T|T < 7317577325741928448 or (T in {7317577325741928448})}]
I20260812 06:58:21.806130 1971 tablet_replica.cc:439] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "deaf71fda6af4795b35902090772ea5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } } }
I20260812 06:58:21.806339 1971 tablet_replica.cc:442] T 14e83ad1f56f4d188d8464ff3e6aae02 P 373e647ae0154576aa605563267ff97b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:58:21.822990 2053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.817958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:45095 (local address 127.18.70.131:33875)
0812 06:58:21.818118 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.818125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.818555 (+ 430us) server_negotiation.cc:407] Connection header received
0812 06:58:21.818740 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.818745 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.818814 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.818883 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:58:21.819336 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.820052 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.821344 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.821792 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.821948 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.822318 (+ 370us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:58:21.822418 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:58:21.822490 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.822614 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.822693 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:58:21.823062 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.817884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:33875 (local address 127.18.70.129:45095)
0812 06:58:21.818461 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:21.818477 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:21.818610 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:21.818911 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:21.818915 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:21.818927 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:58:21.819189 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.819199 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.820172 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.820178 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.821213 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.821225 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.821974 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.821980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.822108 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.822164 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:58:21.822508 (+ 344us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:58:21.822520 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 06:58:21.822586 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 06:58:21.822716 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":250,"threads_started":1}
I20260812 06:58:21.831939 1567 raft_consensus.cc:1261] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Refusing update from remote peer aa6b2b30324c4180aad5a825ab602d65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:21.832031 1823 raft_consensus.cc:1261] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Refusing update from remote peer aa6b2b30324c4180aad5a825ab602d65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:21.832471 1972 consensus_queue.cc:1035] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:21.832720 1995 consensus_queue.cc:1035] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:21.865222 1945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.858873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:56857 (local address 127.18.70.129:38665)
0812 06:58:21.859054 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.859060 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.859702 (+ 642us) server_negotiation.cc:407] Connection header received
0812 06:58:21.859909 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.859914 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.860004 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.860086 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:58:21.860677 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.861610 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.863178 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.863746 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.863852 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.864399 (+ 547us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:58:21.864553 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:58:21.864620 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.864846 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.864928 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 06:58:21.865861 2074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.858924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:38665 (local address 127.18.70.131:56857)
0812 06:58:21.859602 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:21.859622 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:21.859770 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:21.860119 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:21.860123 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:21.860135 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:58:21.860513 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.860525 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.861732 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.861738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.863040 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:21.863053 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.863925 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.863932 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:21.864123 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.864198 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:58:21.864700 (+ 502us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:58:21.864709 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:58:21.865405 (+ 696us) client_negotiation.cc:240] Negotiation successful
0812 06:58:21.865538 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":306,"threads_started":1}
I20260812 06:58:21.896399 1024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:21.896606 1024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:21.899470 1024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb: Sending DeleteTablet for 3 replicas of tablet a83d521105a74b8ab655bb767824a744
I20260812 06:58:21.900143 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet a83d521105a74b8ab655bb767824a744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:21 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:34386
I20260812 06:58:21.900216 1536 tablet_service.cc:1514] Processing DeleteTablet for tablet a83d521105a74b8ab655bb767824a744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:21 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:39258
I20260812 06:58:21.900787 2077 tablet_replica.cc:330] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65: stopping tablet replica
I20260812 06:58:21.900812 1780 tablet_service.cc:1514] Processing DeleteTablet for tablet a83d521105a74b8ab655bb767824a744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:21 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:55504
I20260812 06:58:21.901136 2077 raft_consensus.cc:2229] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:58:21.901489 2077 raft_consensus.cc:2258] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:21.906090 2077 ts_tablet_manager.cc:1905] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:21.909797 2082 tablet_replica.cc:330] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d: stopping tablet replica
I20260812 06:58:21.910156 2082 raft_consensus.cc:2229] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:21.910514 2082 raft_consensus.cc:2258] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:21.911703 2082 ts_tablet_manager.cc:1905] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:21.913179 2077 ts_tablet_manager.cc:1918] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:58:21.913316 2077 log.cc:1196] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/a83d521105a74b8ab655bb767824a744
I20260812 06:58:21.913764 2077 ts_tablet_manager.cc:1939] T a83d521105a74b8ab655bb767824a744 P aa6b2b30324c4180aad5a825ab602d65: Deleting consensus metadata
I20260812 06:58:21.914846 990 catalog_manager.cc:4841] TS aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129:38665): tablet a83d521105a74b8ab655bb767824a744 (table test-table [id=24c6c2de063d48dabea28404a3a3eae7]) successfully deleted
I20260812 06:58:21.919291 2082 ts_tablet_manager.cc:1918] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:58:21.919488 2082 log.cc:1196] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/a83d521105a74b8ab655bb767824a744
I20260812 06:58:21.920047 2082 ts_tablet_manager.cc:1939] T a83d521105a74b8ab655bb767824a744 P deaf71fda6af4795b35902090772ea5d: Deleting consensus metadata
I20260812 06:58:21.921169 996 catalog_manager.cc:4841] TS deaf71fda6af4795b35902090772ea5d (127.18.70.131:33875): tablet a83d521105a74b8ab655bb767824a744 (table test-table [id=24c6c2de063d48dabea28404a3a3eae7]) successfully deleted
I20260812 06:58:21.921914 2080 tablet_replica.cc:330] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b: stopping tablet replica
I20260812 06:58:21.922133 2080 raft_consensus.cc:2229] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:21.922353 2080 raft_consensus.cc:2258] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:21.923331 2080 ts_tablet_manager.cc:1905] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:21.930176 2080 ts_tablet_manager.cc:1918] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:58:21.930305 2080 log.cc:1196] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/a83d521105a74b8ab655bb767824a744
I20260812 06:58:21.930711 2080 ts_tablet_manager.cc:1939] T a83d521105a74b8ab655bb767824a744 P 373e647ae0154576aa605563267ff97b: Deleting consensus metadata
I20260812 06:58:21.931722 992 catalog_manager.cc:4841] TS 373e647ae0154576aa605563267ff97b (127.18.70.130:42495): tablet a83d521105a74b8ab655bb767824a744 (table test-table [id=24c6c2de063d48dabea28404a3a3eae7]) successfully deleted
Aug 12 06:58:21 dist-test-slave-tc2s krb5kdc[935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:58:21 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:21 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:58:21.969229 2034 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:21.958193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37100 (local address 127.18.70.190:38725)
0812 06:58:21.958395 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.958402 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.958806 (+ 404us) server_negotiation.cc:407] Connection header received
0812 06:58:21.958982 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.958989 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.959090 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.959216 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:21.960458 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.961625 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.962847 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.963509 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.963643 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.969023 (+ 5380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37100: BlockingRecv error: recv got EOF from 127.0.0.1:37100 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 06:58:21 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM
I20260812 06:58:21.989609 2034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:21.971933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37104 (local address 127.18.70.190:38725)
0812 06:58:21.972101 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:21.972106 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:21.972367 (+ 261us) server_negotiation.cc:407] Connection header received
0812 06:58:21.972508 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:21.972514 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:21.972589 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:21.972690 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:21.973847 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.975034 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.976313 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:21.976751 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:21.976875 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:21.983155 (+ 6280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:21.983163 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:21.983168 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:21.983206 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:21.986505 (+ 3299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:21.987303 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:21.987309 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:21.987313 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:21.987468 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:21.987893 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:21.987898 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:21.987902 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:21.988255 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:21.988507 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:21.989020 (+ 513us) server_negotiation.cc:299] Negotiation successful
0812 06:58:21.989247 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 06:58:21.994223 1024 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:58:21.994908 1024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:58:22.002094 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 52d3fbc0afbb44b1a39b63df58469980 (DEFAULT_TABLE table=test-table [id=d54d799af2a84c30a3cd603899cd9423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:22.002470 1536 tablet_service.cc:1467] Processing CreateTablet for tablet 52d3fbc0afbb44b1a39b63df58469980 (DEFAULT_TABLE table=test-table [id=d54d799af2a84c30a3cd603899cd9423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:22.002583 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52d3fbc0afbb44b1a39b63df58469980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:22.002943 1536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52d3fbc0afbb44b1a39b63df58469980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:22.007337 1960 tablet_bootstrap.cc:492] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65: Bootstrap starting.
I20260812 06:58:22.007817 1957 tablet_bootstrap.cc:492] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b: Bootstrap starting.
I20260812 06:58:22.008137 1780 tablet_service.cc:1467] Processing CreateTablet for tablet 52d3fbc0afbb44b1a39b63df58469980 (DEFAULT_TABLE table=test-table [id=d54d799af2a84c30a3cd603899cd9423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:22.008569 1780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52d3fbc0afbb44b1a39b63df58469980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:22.008921 1960 tablet_bootstrap.cc:654] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:22.009300 1957 tablet_bootstrap.cc:654] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:22.015763 1952 tablet_bootstrap.cc:492] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d: Bootstrap starting.
I20260812 06:58:22.017377 1952 tablet_bootstrap.cc:654] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:22.018229 1960 tablet_bootstrap.cc:492] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65: No bootstrap required, opened a new log
I20260812 06:58:22.018373 1960 ts_tablet_manager.cc:1397] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260812 06:58:22.019765 1952 tablet_bootstrap.cc:492] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d: No bootstrap required, opened a new log
I20260812 06:58:22.019986 1952 ts_tablet_manager.cc:1397] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.001s
I20260812 06:58:22.020236 1960 raft_consensus.cc:348] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.020517 1960 raft_consensus.cc:374] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:22.020606 1960 raft_consensus.cc:729] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6b2b30324c4180aad5a825ab602d65, State: Initialized, Role: FOLLOWER
I20260812 06:58:22.020860 1960 consensus_queue.cc:260] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.021032 1952 raft_consensus.cc:348] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.021286 1952 raft_consensus.cc:374] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:22.021382 1952 raft_consensus.cc:729] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deaf71fda6af4795b35902090772ea5d, State: Initialized, Role: FOLLOWER
I20260812 06:58:22.021625 1952 consensus_queue.cc:260] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.022243 1952 ts_tablet_manager.cc:1428] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:58:22.023828 1960 ts_tablet_manager.cc:1428] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260812 06:58:22.027465 1957 tablet_bootstrap.cc:492] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b: No bootstrap required, opened a new log
I20260812 06:58:22.027717 1957 ts_tablet_manager.cc:1397] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.004s
I20260812 06:58:22.028517 1957 raft_consensus.cc:348] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.028759 1957 raft_consensus.cc:374] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:22.028849 1957 raft_consensus.cc:729] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 373e647ae0154576aa605563267ff97b, State: Initialized, Role: FOLLOWER
I20260812 06:58:22.029057 1957 consensus_queue.cc:260] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.029601 1957 ts_tablet_manager.cc:1428] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:58:22.111120 1972 raft_consensus.cc:482] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:58:22.111326 1972 raft_consensus.cc:504] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.111967 1972 leader_election.cc:288] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 373e647ae0154576aa605563267ff97b (127.18.70.130:42495), deaf71fda6af4795b35902090772ea5d (127.18.70.131:33875)
I20260812 06:58:22.112468 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d3fbc0afbb44b1a39b63df58469980" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e647ae0154576aa605563267ff97b" is_pre_election: true
I20260812 06:58:22.112659 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d3fbc0afbb44b1a39b63df58469980" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deaf71fda6af4795b35902090772ea5d" is_pre_election: true
I20260812 06:58:22.112776 1566 raft_consensus.cc:2454] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 0.
I20260812 06:58:22.112907 1823 raft_consensus.cc:2454] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 0.
I20260812 06:58:22.113216 1179 leader_election.cc:302] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 373e647ae0154576aa605563267ff97b, aa6b2b30324c4180aad5a825ab602d65; no voters:
I20260812 06:58:22.113518 1972 raft_consensus.cc:2781] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:58:22.113634 1972 raft_consensus.cc:482] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:58:22.113770 1972 raft_consensus.cc:3037] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:22.116928 1972 raft_consensus.cc:504] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.117604 1972 leader_election.cc:288] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 election: Requested vote from peers 373e647ae0154576aa605563267ff97b (127.18.70.130:42495), deaf71fda6af4795b35902090772ea5d (127.18.70.131:33875)
I20260812 06:58:22.118029 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d3fbc0afbb44b1a39b63df58469980" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e647ae0154576aa605563267ff97b"
I20260812 06:58:22.118235 1566 raft_consensus.cc:3037] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:22.118237 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52d3fbc0afbb44b1a39b63df58469980" candidate_uuid: "aa6b2b30324c4180aad5a825ab602d65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deaf71fda6af4795b35902090772ea5d"
I20260812 06:58:22.118476 1823 raft_consensus.cc:3037] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:22.120282 1566 raft_consensus.cc:2454] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 1.
I20260812 06:58:22.120664 1179 leader_election.cc:302] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 373e647ae0154576aa605563267ff97b, aa6b2b30324c4180aad5a825ab602d65; no voters:
I20260812 06:58:22.120910 1972 raft_consensus.cc:2781] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:22.121160 1972 raft_consensus.cc:686] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 1 LEADER]: Becoming Leader. State: Replica: aa6b2b30324c4180aad5a825ab602d65, State: Running, Role: LEADER
I20260812 06:58:22.121407 1972 consensus_queue.cc:237] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.121579 1823 raft_consensus.cc:2454] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa6b2b30324c4180aad5a825ab602d65 in term 1.
I20260812 06:58:22.124181 1021 catalog_manager.cc:5495] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129). New cstate: current_term: 1 leader_uuid: "aa6b2b30324c4180aad5a825ab602d65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } health_report { overall_health: UNKNOWN } } }
I20260812 06:58:22.138474 1945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:22.133062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34390 (local address 127.18.70.129:38665)
0812 06:58:22.133244 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:22.133250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:22.133402 (+ 152us) server_negotiation.cc:407] Connection header received
0812 06:58:22.133587 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:22.133590 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:22.133652 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:22.133721 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:58:22.134142 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.134857 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.136771 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.137165 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.137254 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:22.137790 (+ 536us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:58:22.137951 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:58:22.138021 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:22.138171 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 06:58:22.138233 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 06:58:22.140993 1823 raft_consensus.cc:1261] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Refusing update from remote peer aa6b2b30324c4180aad5a825ab602d65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:22.141142 1566 raft_consensus.cc:1261] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Refusing update from remote peer aa6b2b30324c4180aad5a825ab602d65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:22.141563 1972 consensus_queue.cc:1035] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:22.141873 2075 consensus_queue.cc:1035] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:22.153497 1024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:22.153721 1024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:22.157233 1024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb: Sending DeleteTablet for 3 replicas of tablet 52d3fbc0afbb44b1a39b63df58469980
I20260812 06:58:22.158041 1780 tablet_service.cc:1514] Processing DeleteTablet for tablet 52d3fbc0afbb44b1a39b63df58469980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:22 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:55504
I20260812 06:58:22.158219 1538 tablet_service.cc:1514] Processing DeleteTablet for tablet 52d3fbc0afbb44b1a39b63df58469980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:22 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:39258
I20260812 06:58:22.158242 1536 tablet_service.cc:1514] Processing DeleteTablet for tablet 52d3fbc0afbb44b1a39b63df58469980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:22 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:39258
I20260812 06:58:22.158522 2082 tablet_replica.cc:330] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d: stopping tablet replica
I20260812 06:58:22.158726 2082 raft_consensus.cc:2229] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:22.158932 2082 raft_consensus.cc:2258] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:22.159210 2080 tablet_replica.cc:330] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b: stopping tablet replica
I20260812 06:58:22.159394 2080 raft_consensus.cc:2229] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:22.159552 2080 raft_consensus.cc:2258] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:22.160431 2080 ts_tablet_manager.cc:1905] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:22.162539 2082 ts_tablet_manager.cc:1905] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:22.164712 2080 ts_tablet_manager.cc:1918] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:22.164819 2080 log.cc:1196] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/52d3fbc0afbb44b1a39b63df58469980
I20260812 06:58:22.165114 2080 ts_tablet_manager.cc:1939] T 52d3fbc0afbb44b1a39b63df58469980 P 373e647ae0154576aa605563267ff97b: Deleting consensus metadata
I20260812 06:58:22.165969 992 catalog_manager.cc:4841] TS 373e647ae0154576aa605563267ff97b (127.18.70.130:42495): tablet 52d3fbc0afbb44b1a39b63df58469980 (table test-table [id=d54d799af2a84c30a3cd603899cd9423]) successfully deleted
W20260812 06:58:22.166378 992 catalog_manager.cc:4808] TS 373e647ae0154576aa605563267ff97b (127.18.70.130:42495): delete failed for tablet 52d3fbc0afbb44b1a39b63df58469980 because the tablet was not found. No further retry: Not found: Tablet not found: 52d3fbc0afbb44b1a39b63df58469980
I20260812 06:58:22.166985 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 52d3fbc0afbb44b1a39b63df58469980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:22 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:34386
I20260812 06:58:22.167284 2077 tablet_replica.cc:330] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65: stopping tablet replica
I20260812 06:58:22.167469 2077 raft_consensus.cc:2229] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:58:22.167765 2077 raft_consensus.cc:2258] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:22.168329 1024 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 06:58:22.168884 2077 ts_tablet_manager.cc:1905] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 06:58:22.169348 1024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:58:22.169751 2082 ts_tablet_manager.cc:1918] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:22.169947 2082 log.cc:1196] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/52d3fbc0afbb44b1a39b63df58469980
I20260812 06:58:22.170503 2082 ts_tablet_manager.cc:1939] T 52d3fbc0afbb44b1a39b63df58469980 P deaf71fda6af4795b35902090772ea5d: Deleting consensus metadata
I20260812 06:58:22.174028 996 catalog_manager.cc:4841] TS deaf71fda6af4795b35902090772ea5d (127.18.70.131:33875): tablet 52d3fbc0afbb44b1a39b63df58469980 (table test-table [id=d54d799af2a84c30a3cd603899cd9423]) successfully deleted
I20260812 06:58:22.174587 2077 ts_tablet_manager.cc:1918] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:22.174736 2077 log.cc:1196] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/52d3fbc0afbb44b1a39b63df58469980
I20260812 06:58:22.175139 2077 ts_tablet_manager.cc:1939] T 52d3fbc0afbb44b1a39b63df58469980 P aa6b2b30324c4180aad5a825ab602d65: Deleting consensus metadata
I20260812 06:58:22.176055 990 catalog_manager.cc:4841] TS aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129:38665): tablet 52d3fbc0afbb44b1a39b63df58469980 (table test-table [id=d54d799af2a84c30a3cd603899cd9423]) successfully deleted
I20260812 06:58:22.176801 1280 tablet_service.cc:1467] Processing CreateTablet for tablet c7b0b12c689f46d8a444b73608d5e40b (DEFAULT_TABLE table=test-table [id=a071779e14f2428dbff37a8276c33a2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:22.177011 1536 tablet_service.cc:1467] Processing CreateTablet for tablet c7b0b12c689f46d8a444b73608d5e40b (DEFAULT_TABLE table=test-table [id=a071779e14f2428dbff37a8276c33a2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:22.177179 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7b0b12c689f46d8a444b73608d5e40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:22.177374 1536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7b0b12c689f46d8a444b73608d5e40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:22.177282 1780 tablet_service.cc:1467] Processing CreateTablet for tablet c7b0b12c689f46d8a444b73608d5e40b (DEFAULT_TABLE table=test-table [id=a071779e14f2428dbff37a8276c33a2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:22.177702 1780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7b0b12c689f46d8a444b73608d5e40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:22.183018 1960 tablet_bootstrap.cc:492] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65: Bootstrap starting.
I20260812 06:58:22.183745 1957 tablet_bootstrap.cc:492] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b: Bootstrap starting.
I20260812 06:58:22.184201 1952 tablet_bootstrap.cc:492] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d: Bootstrap starting.
I20260812 06:58:22.184562 1960 tablet_bootstrap.cc:654] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:22.185199 1957 tablet_bootstrap.cc:654] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:22.185863 1952 tablet_bootstrap.cc:654] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:22.195209 1960 tablet_bootstrap.cc:492] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65: No bootstrap required, opened a new log
I20260812 06:58:22.195421 1960 ts_tablet_manager.cc:1397] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260812 06:58:22.196260 1960 raft_consensus.cc:348] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.196606 1960 raft_consensus.cc:374] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:22.196739 1960 raft_consensus.cc:729] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6b2b30324c4180aad5a825ab602d65, State: Initialized, Role: FOLLOWER
I20260812 06:58:22.197027 1960 consensus_queue.cc:260] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.197181 1957 tablet_bootstrap.cc:492] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b: No bootstrap required, opened a new log
I20260812 06:58:22.197326 1957 ts_tablet_manager.cc:1397] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.007s
I20260812 06:58:22.197646 1960 ts_tablet_manager.cc:1428] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260812 06:58:22.198093 1957 raft_consensus.cc:348] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.198329 1957 raft_consensus.cc:374] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:22.198406 1957 raft_consensus.cc:729] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 373e647ae0154576aa605563267ff97b, State: Initialized, Role: FOLLOWER
I20260812 06:58:22.198657 1957 consensus_queue.cc:260] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.200981 1957 ts_tablet_manager.cc:1428] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 06:58:22.202664 1952 tablet_bootstrap.cc:492] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d: No bootstrap required, opened a new log
I20260812 06:58:22.202885 1952 ts_tablet_manager.cc:1397] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.007s
I20260812 06:58:22.203778 1952 raft_consensus.cc:348] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.204064 1952 raft_consensus.cc:374] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:22.204152 1952 raft_consensus.cc:729] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deaf71fda6af4795b35902090772ea5d, State: Initialized, Role: FOLLOWER
I20260812 06:58:22.204386 1952 consensus_queue.cc:260] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.204839 1952 ts_tablet_manager.cc:1428] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260812 06:58:22.205502 2044 raft_consensus.cc:482] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:58:22.205657 2044 raft_consensus.cc:504] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.206283 2044 leader_election.cc:288] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129:38665), 373e647ae0154576aa605563267ff97b (127.18.70.130:42495)
I20260812 06:58:22.206670 1315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7b0b12c689f46d8a444b73608d5e40b" candidate_uuid: "deaf71fda6af4795b35902090772ea5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6b2b30324c4180aad5a825ab602d65" is_pre_election: true
I20260812 06:58:22.206878 1315 raft_consensus.cc:2454] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deaf71fda6af4795b35902090772ea5d in term 0.
I20260812 06:58:22.207288 1695 leader_election.cc:302] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa6b2b30324c4180aad5a825ab602d65, deaf71fda6af4795b35902090772ea5d; no voters:
I20260812 06:58:22.207561 2044 raft_consensus.cc:2781] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:58:22.207664 2044 raft_consensus.cc:482] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:58:22.207778 2044 raft_consensus.cc:3037] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:22.207770 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7b0b12c689f46d8a444b73608d5e40b" candidate_uuid: "deaf71fda6af4795b35902090772ea5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e647ae0154576aa605563267ff97b" is_pre_election: true
I20260812 06:58:22.208063 1566 raft_consensus.cc:2454] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate deaf71fda6af4795b35902090772ea5d in term 0.
I20260812 06:58:22.210161 2044 raft_consensus.cc:504] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.210672 2044 leader_election.cc:288] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [CANDIDATE]: Term 1 election: Requested vote from peers aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129:38665), 373e647ae0154576aa605563267ff97b (127.18.70.130:42495)
I20260812 06:58:22.211045 1315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7b0b12c689f46d8a444b73608d5e40b" candidate_uuid: "deaf71fda6af4795b35902090772ea5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6b2b30324c4180aad5a825ab602d65"
I20260812 06:58:22.211105 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7b0b12c689f46d8a444b73608d5e40b" candidate_uuid: "deaf71fda6af4795b35902090772ea5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e647ae0154576aa605563267ff97b"
I20260812 06:58:22.211232 1315 raft_consensus.cc:3037] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:22.211256 1566 raft_consensus.cc:3037] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:22.213989 1315 raft_consensus.cc:2454] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deaf71fda6af4795b35902090772ea5d in term 1.
I20260812 06:58:22.213989 1566 raft_consensus.cc:2454] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate deaf71fda6af4795b35902090772ea5d in term 1.
I20260812 06:58:22.214349 1697 leader_election.cc:302] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 373e647ae0154576aa605563267ff97b, deaf71fda6af4795b35902090772ea5d; no voters:
I20260812 06:58:22.214634 2044 raft_consensus.cc:2781] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:22.214820 2044 raft_consensus.cc:686] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 1 LEADER]: Becoming Leader. State: Replica: deaf71fda6af4795b35902090772ea5d, State: Running, Role: LEADER
I20260812 06:58:22.215065 2044 consensus_queue.cc:237] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } }
I20260812 06:58:22.217432 1024 catalog_manager.cc:5495] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d reported cstate change: term changed from 0 to 1, leader changed from <none> to deaf71fda6af4795b35902090772ea5d (127.18.70.131). New cstate: current_term: 1 leader_uuid: "deaf71fda6af4795b35902090772ea5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deaf71fda6af4795b35902090772ea5d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 33875 } health_report { overall_health: HEALTHY } } }
I20260812 06:58:22.238528 2053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:22.233405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55522 (local address 127.18.70.131:33875)
0812 06:58:22.233554 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:22.233559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:22.233622 (+ 63us) server_negotiation.cc:407] Connection header received
0812 06:58:22.233784 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:22.233788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:22.233875 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:22.234009 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:58:22.234393 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.235125 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.236971 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.237350 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.237435 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:22.237860 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:58:22.238000 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:58:22.238062 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:22.238173 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 06:58:22.238231 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:58:22.250761 2053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:22.246216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:51609 (local address 127.18.70.131:33875)
0812 06:58:22.246392 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:22.246396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:22.246411 (+ 15us) server_negotiation.cc:407] Connection header received
0812 06:58:22.246559 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:22.246562 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:22.246617 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:22.246680 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:58:22.247012 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.247677 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.249198 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.249616 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.249699 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:22.250149 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:58:22.250265 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:58:22.250327 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:22.250458 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 06:58:22.250539 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":59}
I20260812 06:58:22.250963 2074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:22.246157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:33875 (local address 127.18.70.131:51609)
0812 06:58:22.246347 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:22.246368 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:22.246465 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:22.246705 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:22.246710 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:22.246721 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:58:22.246890 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:22.246899 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.247795 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.247800 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:22.249083 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:22.249096 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.249753 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.249759 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:22.249970 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:22.250016 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:58:22.250357 (+ 341us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:58:22.250366 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:58:22.250440 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:58:22.250595 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":2}
I20260812 06:58:22.258060 1566 raft_consensus.cc:1261] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Refusing update from remote peer deaf71fda6af4795b35902090772ea5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:22.258100 1315 raft_consensus.cc:1261] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Refusing update from remote peer deaf71fda6af4795b35902090772ea5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:22.258558 1970 consensus_queue.cc:1035] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "373e647ae0154576aa605563267ff97b" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:22.258817 2044 consensus_queue.cc:1035] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa6b2b30324c4180aad5a825ab602d65" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:22.299778 1021 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:22.300030 1021 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:22.303068 1021 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bdf43bc29b3f409384e825d9f80a89cb: Sending DeleteTablet for 3 replicas of tablet c7b0b12c689f46d8a444b73608d5e40b
I20260812 06:58:22.303900 1780 tablet_service.cc:1514] Processing DeleteTablet for tablet c7b0b12c689f46d8a444b73608d5e40b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:22 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:55504
I20260812 06:58:22.303891 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet c7b0b12c689f46d8a444b73608d5e40b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:22 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:34386
I20260812 06:58:22.304169 2077 tablet_replica.cc:330] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65: stopping tablet replica
I20260812 06:58:22.304165 2082 tablet_replica.cc:330] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d: stopping tablet replica
I20260812 06:58:22.304329 2077 raft_consensus.cc:2229] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:22.304340 2082 raft_consensus.cc:2229] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:58:22.304519 2077 raft_consensus.cc:2258] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:22.304847 2082 raft_consensus.cc:2258] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:22.305116 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 1150
I20260812 06:58:22.305681 2077 ts_tablet_manager.cc:1905] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:22.305974 2082 ts_tablet_manager.cc:1905] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:22.310258 1536 tablet_service.cc:1514] Processing DeleteTablet for tablet c7b0b12c689f46d8a444b73608d5e40b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:22 UTC) from {username='oryx', principal='oryx/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:39258
I20260812 06:58:22.310545 2080 tablet_replica.cc:330] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b: stopping tablet replica
I20260812 06:58:22.310716 2080 raft_consensus.cc:2229] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:22.310912 2080 raft_consensus.cc:2258] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:22.312743 2082 ts_tablet_manager.cc:1918] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:58:22.312932 2082 log.cc:1196] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/c7b0b12c689f46d8a444b73608d5e40b
I20260812 06:58:22.313508 2077 ts_tablet_manager.cc:1918] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:58:22.313643 2077 log.cc:1196] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/c7b0b12c689f46d8a444b73608d5e40b
I20260812 06:58:22.313678 2082 ts_tablet_manager.cc:1939] T c7b0b12c689f46d8a444b73608d5e40b P deaf71fda6af4795b35902090772ea5d: Deleting consensus metadata
I20260812 06:58:22.314136 2077 ts_tablet_manager.cc:1939] T c7b0b12c689f46d8a444b73608d5e40b P aa6b2b30324c4180aad5a825ab602d65: Deleting consensus metadata
I20260812 06:58:22.314795 2080 ts_tablet_manager.cc:1905] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:22.314849 996 catalog_manager.cc:4841] TS deaf71fda6af4795b35902090772ea5d (127.18.70.131:33875): tablet c7b0b12c689f46d8a444b73608d5e40b (table test-table [id=a071779e14f2428dbff37a8276c33a2c]) successfully deleted
I20260812 06:58:22.318044 990 catalog_manager.cc:4841] TS aa6b2b30324c4180aad5a825ab602d65 (127.18.70.129:38665): tablet c7b0b12c689f46d8a444b73608d5e40b (table test-table [id=a071779e14f2428dbff37a8276c33a2c]) successfully deleted
I20260812 06:58:22.321511 2080 ts_tablet_manager.cc:1918] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:58:22.321632 2080 log.cc:1196] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/c7b0b12c689f46d8a444b73608d5e40b
I20260812 06:58:22.322078 2080 ts_tablet_manager.cc:1939] T c7b0b12c689f46d8a444b73608d5e40b P 373e647ae0154576aa605563267ff97b: Deleting consensus metadata
Aug 12 06:58:22 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.70.129@KRBTEST.COM
I20260812 06:58:22.323146 992 catalog_manager.cc:4841] TS 373e647ae0154576aa605563267ff97b (127.18.70.130:42495): tablet c7b0b12c689f46d8a444b73608d5e40b (table test-table [id=a071779e14f2428dbff37a8276c33a2c]) successfully deleted
I20260812 06:58:22.329746 1945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:22.306971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34392 (local address 127.18.70.129:38665)
0812 06:58:22.307148 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:22.307154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:22.315489 (+ 8335us) server_negotiation.cc:407] Connection header received
0812 06:58:22.315641 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:22.315646 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:22.315730 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:22.315809 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:22.316959 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.317859 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.319345 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.319747 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.319853 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:22.324293 (+ 4440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:22.324306 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:22.324322 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:22.324351 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:22.327205 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:22.327990 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:22.327997 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:22.328000 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:22.328124 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:22.328496 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:22.328500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:22.328502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:22.328811 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:22.329063 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:22.329323 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 06:58:22.329513 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 06:58:22.330281 1410 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:22.487787 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 1150
I20260812 06:58:22.518389 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 1420
Aug 12 06:58:22 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.70.130@KRBTEST.COM
I20260812 06:58:22.535861 2142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:22.519117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39274 (local address 127.18.70.130:42495)
0812 06:58:22.519623 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:22.519627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:22.519644 (+ 17us) server_negotiation.cc:407] Connection header received
0812 06:58:22.519696 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:22.519700 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:22.519756 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:22.519844 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:22.521436 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.522331 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.524120 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.524536 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.524622 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:22.529615 (+ 4993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:22.529630 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:22.529646 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:22.529686 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:22.532526 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:22.533159 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:22.533167 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:22.533169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:22.533306 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:22.533657 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:22.533660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:22.533662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:22.534119 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:22.534447 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:22.535441 (+ 994us) server_negotiation.cc:299] Negotiation successful
0812 06:58:22.535607 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":273,"threads_started":1}
I20260812 06:58:22.536476 1651 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:22.631982 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 1420
I20260812 06:58:22.659226 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 1669
Aug 12 06:58:22 dist-test-slave-tc2s krb5kdc[935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.70.131@KRBTEST.COM
I20260812 06:58:22.674649 2053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:22.659980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50556 (local address 127.18.70.131:33875)
0812 06:58:22.660160 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:22.660166 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:22.660299 (+ 133us) server_negotiation.cc:407] Connection header received
0812 06:58:22.660494 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:22.660499 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:22.660590 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:22.660681 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:22.661968 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.662727 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.663958 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:22.664441 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:22.664553 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:22.668941 (+ 4388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:22.668955 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:22.668973 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:22.669013 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:22.671977 (+ 2964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:22.672612 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:22.672619 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:22.672621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:22.672764 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:22.673116 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:22.673119 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:22.673122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:22.673492 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:22.673821 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:22.674077 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 06:58:22.674293 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 06:58:22.675343 1895 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:22.829110 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 1669
I20260812 06:58:22.857057 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 958
I20260812 06:58:22.858212 1091 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:22.971149 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 958
2026-08-12T06:58:22Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6494 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:58:23 dist-test-slave-tc2s krb5kdc[2152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:58:23 dist-test-slave-tc2s krb5kdc[2152](info): set up 2 sockets
Aug 12 06:58:23 dist-test-slave-tc2s krb5kdc[2152](info): commencing operation
krb5kdc: starting...
W20260812 06:58:24.206241 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.003s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:58:24 dist-test-slave-tc2s krb5kdc[2152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:58:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:58:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:58:24.414961 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41389
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:42129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:41389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:24.730213 2176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:24.730491 2176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:24.730623 2176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:24.737694 2176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:58:24.737795 2176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:24.737874 2176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:24.737968 2176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:58:24.738032 2176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:58:24.748028 2176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:42129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:41389
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:24.749208 2176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:24.750499 2176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:24.761732 2188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:24.761816 2189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:24.761777 2192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:24.762847 2176 server_base.cc:1034] running on GCE node
I20260812 06:58:24.763536 2176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:24.764779 2176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:24.765983 2176 hybrid_clock.cc:648] HybridClock initialized: now 1786517904765936 us; error 30 us; skew 500 ppm
I20260812 06:58:24.766289 2176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T06:58:24Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1863 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:58:24 dist-test-slave-tc2s krb5kdc[2205](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:58:24 dist-test-slave-tc2s krb5kdc[2205](info): set up 2 sockets
Aug 12 06:58:24 dist-test-slave-tc2s krb5kdc[2205](info): commencing operation
krb5kdc: starting...
W20260812 06:58:26.084031 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.002s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:58:26 dist-test-slave-tc2s krb5kdc[2205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:58:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:58:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:58:26.301065 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:38933
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:38933
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:26.620596 2226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:26.620880 2226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:26.621001 2226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:26.628046 2226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:58:26.628145 2226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:26.628221 2226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:26.628293 2226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:58:26.628355 2226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:58:26.637969 2226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:38933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:38933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:26.639233 2226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:26.640527 2226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:26.651576 2231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:26.651645 2232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:26.651805 2235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:26.652597 2226 server_base.cc:1034] running on GCE node
I20260812 06:58:26.653311 2226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:26.654688 2226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:26.655882 2226 hybrid_clock.cc:648] HybridClock initialized: now 1786517906655835 us; error 39 us; skew 500 ppm
I20260812 06:58:26.656196 2226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:26 dist-test-slave-tc2s krb5kdc[2205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517906, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:26.662806 2226 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:58:26.664194 2226 webserver.cc:460] Webserver started at http://127.18.70.190:36195/ using document root <none> and password file <none>
I20260812 06:58:26.664855 2226 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:26.664959 2226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:26.665258 2226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:26.668187 2226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "99edae990e364968a61c11a4d2f1c788"
format_stamp: "Formatted at 2026-08-12 06:58:26 on dist-test-slave-tc2s"
server_key: "f0594d7580f1d1b846fd5631bb950d86"
server_key_iv: "484e33f7650d2b8be406331de9ec9919"
server_key_version: "encryptionkey@0"
I20260812 06:58:26.668927 2226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "99edae990e364968a61c11a4d2f1c788"
format_stamp: "Formatted at 2026-08-12 06:58:26 on dist-test-slave-tc2s"
server_key: "f0594d7580f1d1b846fd5631bb950d86"
server_key_iv: "484e33f7650d2b8be406331de9ec9919"
server_key_version: "encryptionkey@0"
I20260812 06:58:26.673837 2226 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260812 06:58:26.677105 2248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:26.678390 2226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:58:26.678552 2226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "99edae990e364968a61c11a4d2f1c788"
format_stamp: "Formatted at 2026-08-12 06:58:26 on dist-test-slave-tc2s"
server_key: "f0594d7580f1d1b846fd5631bb950d86"
server_key_iv: "484e33f7650d2b8be406331de9ec9919"
server_key_version: "encryptionkey@0"
I20260812 06:58:26.678722 2226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:26.692906 2226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:26.696851 2226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:26.697103 2226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:26.714155 2226 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:38933
I20260812 06:58:26.714178 2343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:38933 every 8 connection(s)
I20260812 06:58:26.715512 2226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:58:26.718381 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 2226
I20260812 06:58:26.718645 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:58:26.719467 18714 external_mini_cluster.cc:1428] Setting key da73675faadbfb926cd77c1b91bf27ac
I20260812 06:58:26.719602 2345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:26.731904 2345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788: Bootstrap starting.
Aug 12 06:58:26 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:26.735561 2345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:26.736591 2345 log.cc:824] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:26.739750 2345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788: No bootstrap required, opened a new log
I20260812 06:58:26.741063 2350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:26.721495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46828 (local address 127.18.70.190:38933)
0812 06:58:26.722236 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:26.722248 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:26.722290 (+ 42us) server_negotiation.cc:407] Connection header received
0812 06:58:26.724305 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:26.724327 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:26.724709 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:26.725083 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:26.726569 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:26.727834 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:26.729103 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:26.729806 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:26.730018 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:26.734208 (+ 4190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:26.734215 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:26.734230 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:26.734264 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:26.737212 (+ 2948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:26.737858 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:26.737865 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:26.737871 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:26.738067 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:26.738451 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:26.738454 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:26.738456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:26.738945 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:26.739152 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:26.739586 (+ 434us) server_negotiation.cc:299] Negotiation successful
0812 06:58:26.740102 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":314,"threads_started":1}
I20260812 06:58:26.747215 2345 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } }
I20260812 06:58:26.747542 2345 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:26.747640 2345 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99edae990e364968a61c11a4d2f1c788, State: Initialized, Role: FOLLOWER
I20260812 06:58:26.748165 2345 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } }
I20260812 06:58:26.748377 2345 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:58:26.748505 2345 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:58:26.748651 2345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:26.750991 2345 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } }
I20260812 06:58:26.751461 2345 leader_election.cc:302] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99edae990e364968a61c11a4d2f1c788; no voters:
I20260812 06:58:26.751986 2345 leader_election.cc:288] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:58:26.752103 2354 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:26.752737 2354 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 1 LEADER]: Becoming Leader. State: Replica: 99edae990e364968a61c11a4d2f1c788, State: Running, Role: LEADER
I20260812 06:58:26.753247 2354 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } }
I20260812 06:58:26.753829 2345 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:58:26.756480 2355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99edae990e364968a61c11a4d2f1c788" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } } }
I20260812 06:58:26.756759 2355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:26.758195 2364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:58:26.757999 2357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99edae990e364968a61c11a4d2f1c788. Latest consensus state: current_term: 1 leader_uuid: "99edae990e364968a61c11a4d2f1c788" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } } }
I20260812 06:58:26.758301 2357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:26.763326 2364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:58:26.772220 2364 catalog_manager.cc:1347] Generated new cluster ID: d8a70228040143cd864bcfb6bff8680f
I20260812 06:58:26.772312 2364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:58:26.789366 2364 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:58:26.790684 2364 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:58:26.799443 2364 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788: Generated new TSK 0
I20260812 06:58:26.800418 2364 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:58:26.859581 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:38933
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:27.187480 2391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:27.187757 2391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:27.187857 2391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:27.194998 2391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:27.195107 2391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:27.195227 2391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:58:27.204933 2391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:27.206240 2391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:27.207477 2391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:27.219936 2400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:27.219964 2399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:27.220126 2403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:27.220717 2391 server_base.cc:1034] running on GCE node
I20260812 06:58:27.221269 2391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:27.222162 2391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:27.223352 2391 hybrid_clock.cc:648] HybridClock initialized: now 1786517907223295 us; error 47 us; skew 500 ppm
I20260812 06:58:27.223615 2391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:27 dist-test-slave-tc2s krb5kdc[2205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517907, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:27.226575 2391 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:58:27.227859 2391 webserver.cc:460] Webserver started at http://127.18.70.129:43621/ using document root <none> and password file <none>
I20260812 06:58:27.228482 2391 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:27.228577 2391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:27.228828 2391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:27.231614 2391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "5f4eec70648546c7a26c3739f078f4fc"
format_stamp: "Formatted at 2026-08-12 06:58:27 on dist-test-slave-tc2s"
server_key: "51ef4862c29b0ff661a0231438549bf0"
server_key_iv: "5585de1be54ffdfab0a6d575f993d14e"
server_key_version: "encryptionkey@0"
I20260812 06:58:27.232336 2391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "5f4eec70648546c7a26c3739f078f4fc"
format_stamp: "Formatted at 2026-08-12 06:58:27 on dist-test-slave-tc2s"
server_key: "51ef4862c29b0ff661a0231438549bf0"
server_key_iv: "5585de1be54ffdfab0a6d575f993d14e"
server_key_version: "encryptionkey@0"
I20260812 06:58:27.237144 2391 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260812 06:58:27.240463 2412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:27.241783 2391 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 06:58:27.241957 2391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "5f4eec70648546c7a26c3739f078f4fc"
format_stamp: "Formatted at 2026-08-12 06:58:27 on dist-test-slave-tc2s"
server_key: "51ef4862c29b0ff661a0231438549bf0"
server_key_iv: "5585de1be54ffdfab0a6d575f993d14e"
server_key_version: "encryptionkey@0"
I20260812 06:58:27.242138 2391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:27.265481 2391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:27.269161 2391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:27.269413 2391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:27.270371 2391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:27.271656 2391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:27.271732 2391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:27.271848 2391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:27.271899 2391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:27.301420 2391 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:45893
I20260812 06:58:27.301509 2610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:45893 every 8 connection(s)
I20260812 06:58:27.302690 2391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:58:27.311996 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 2391
I20260812 06:58:27.312222 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:58:27.312968 18714 external_mini_cluster.cc:1428] Setting key 7bc56248e8b125dc4b8a093e127eb1da
Aug 12 06:58:27 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517907, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:27.321262 2617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:27.305075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:47043 (local address 127.18.70.190:38933)
0812 06:58:27.305497 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:27.305502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:27.306436 (+ 934us) server_negotiation.cc:407] Connection header received
0812 06:58:27.308126 (+ 1690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:27.308131 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:27.308198 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:27.308290 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:27.309620 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:27.310416 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:27.311907 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:27.312506 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:27.312637 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:27.315977 (+ 3340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:27.315982 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:27.315985 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:27.316017 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:27.318386 (+ 2369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:27.319057 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:27.319062 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:27.319064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:27.319189 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:27.319595 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:27.319600 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:27.319602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:27.319856 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:27.319994 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:27.320676 (+ 682us) server_negotiation.cc:299] Negotiation successful
0812 06:58:27.320897 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":201,"threads_started":1}
I20260812 06:58:27.322234 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:27.305594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:47043)
0812 06:58:27.306276 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:27.306316 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:27.307898 (+ 1582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:27.308460 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:27.308467 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:27.308966 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:27.309491 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:27.309508 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:27.310576 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:27.310580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:27.311767 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:27.311779 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:27.312703 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:27.312708 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:27.312904 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:27.313510 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:27.313531 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:27.315772 (+ 2241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:27.318514 (+ 2742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:27.318523 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:27.318537 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:27.318943 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:27.319289 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:27.319294 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:27.319298 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:27.319488 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:27.319985 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:27.319993 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:27.320309 (+ 316us) client_negotiation.cc:769] Sending connection context
0812 06:58:27.320552 (+ 243us) client_negotiation.cc:240] Negotiation successful
0812 06:58:27.321036 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":271,"threads_started":1}
I20260812 06:58:27.323696 2611 heartbeater.cc:347] Connected to a master server at 127.18.70.190:38933
I20260812 06:58:27.324039 2611 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:27.324823 2611 heartbeater.cc:511] Master 127.18.70.190:38933 requested a full tablet report, sending...
I20260812 06:58:27.327090 2282 ts_manager.cc:194] Registered new tserver with Master: 5f4eec70648546c7a26c3739f078f4fc (127.18.70.129:45893)
I20260812 06:58:27.328949 2282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:47043
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 06:58:27.366427 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:38933
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:27.690116 2621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:27.690407 2621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:27.690541 2621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:27.697589 2621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:27.697693 2621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:27.697856 2621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:58:27.707487 2621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:27.708735 2621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:27.710016 2621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:27.723368 2631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:27.723407 2629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:27.724406 2634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:27.730945 2621 server_base.cc:1034] running on GCE node
I20260812 06:58:27.731523 2621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:27.732399 2621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:27.733587 2621 hybrid_clock.cc:648] HybridClock initialized: now 1786517907733540 us; error 37 us; skew 500 ppm
I20260812 06:58:27.733876 2621 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:27 dist-test-slave-tc2s krb5kdc[2205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517907, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:27.736919 2621 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:58:27.738411 2621 webserver.cc:460] Webserver started at http://127.18.70.130:41537/ using document root <none> and password file <none>
I20260812 06:58:27.739071 2621 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:27.739182 2621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:27.739477 2621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:27.742327 2621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "a725b2d04d1642c5b51197fc301561ef"
format_stamp: "Formatted at 2026-08-12 06:58:27 on dist-test-slave-tc2s"
server_key: "689951b7f28f57b8a4ee113a03cbc541"
server_key_iv: "db99c0214e7460c165e95ce8ac5e33e2"
server_key_version: "encryptionkey@0"
I20260812 06:58:27.743065 2621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "a725b2d04d1642c5b51197fc301561ef"
format_stamp: "Formatted at 2026-08-12 06:58:27 on dist-test-slave-tc2s"
server_key: "689951b7f28f57b8a4ee113a03cbc541"
server_key_iv: "db99c0214e7460c165e95ce8ac5e33e2"
server_key_version: "encryptionkey@0"
I20260812 06:58:27.747931 2621 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 06:58:27.751147 2648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:27.752341 2621 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260812 06:58:27.752485 2621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "a725b2d04d1642c5b51197fc301561ef"
format_stamp: "Formatted at 2026-08-12 06:58:27 on dist-test-slave-tc2s"
server_key: "689951b7f28f57b8a4ee113a03cbc541"
server_key_iv: "db99c0214e7460c165e95ce8ac5e33e2"
server_key_version: "encryptionkey@0"
I20260812 06:58:27.752651 2621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:27.777079 2621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:27.780794 2621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:27.781057 2621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:27.782105 2621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:27.783470 2621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:27.783546 2621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:27.783664 2621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:27.783717 2621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:27.813274 2621 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:39209
I20260812 06:58:27.813318 2835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:39209 every 8 connection(s)
I20260812 06:58:27.814539 2621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:58:27.817255 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 2621
I20260812 06:58:27.817433 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:58:27.817886 18714 external_mini_cluster.cc:1428] Setting key 42b37b9dd8a57d928ec43b1029e1ef6b
Aug 12 06:58:27 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517907, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:27.834185 2617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:27.816986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:58033 (local address 127.18.70.190:38933)
0812 06:58:27.817212 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:27.817218 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:27.818483 (+ 1265us) server_negotiation.cc:407] Connection header received
0812 06:58:27.820449 (+ 1966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:27.820455 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:27.820541 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:27.820643 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:27.822066 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:27.822998 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:27.824658 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:27.825220 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:27.825355 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:27.828751 (+ 3396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:27.828756 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:27.828759 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:27.828792 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:27.831146 (+ 2354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:27.831988 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:27.831991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:27.831994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:27.832113 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:27.832540 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:27.832542 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:27.832544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:27.832787 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:27.832888 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:27.833718 (+ 830us) server_negotiation.cc:299] Negotiation successful
0812 06:58:27.833926 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 06:58:27.835479 2839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:27.817481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:58033)
0812 06:58:27.818301 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:27.818352 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:27.820176 (+ 1824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:27.820812 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:27.820819 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:27.821321 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:27.821869 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:27.821886 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:27.823166 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:27.823171 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:27.824486 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:27.824520 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:27.825419 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:27.825424 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:27.825627 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:27.826302 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:27.826326 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:27.828529 (+ 2203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:27.831284 (+ 2755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:27.831305 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:27.831321 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:27.831889 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:27.832208 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:27.832212 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:27.832215 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:27.832451 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:27.832910 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:27.832917 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:27.833324 (+ 407us) client_negotiation.cc:769] Sending connection context
0812 06:58:27.833624 (+ 300us) client_negotiation.cc:240] Negotiation successful
0812 06:58:27.834149 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":293,"threads_started":1}
I20260812 06:58:27.836866 2836 heartbeater.cc:347] Connected to a master server at 127.18.70.190:38933
I20260812 06:58:27.837240 2836 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:27.838095 2836 heartbeater.cc:511] Master 127.18.70.190:38933 requested a full tablet report, sending...
I20260812 06:58:27.839594 2282 ts_manager.cc:194] Registered new tserver with Master: a725b2d04d1642c5b51197fc301561ef (127.18.70.130:39209)
I20260812 06:58:27.840420 2282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:58033
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 06:58:27.872241 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:38933
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:28.192044 2844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:28.192306 2844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:28.192402 2844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:28.199331 2844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:28.199429 2844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:28.199548 2844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:58:28.208930 2844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:28.210103 2844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:28.211293 2844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:28.223666 2857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:28.223737 2853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:28.223714 2854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:28.224236 2844 server_base.cc:1034] running on GCE node
I20260812 06:58:28.224798 2844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:28.225653 2844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:28.226853 2844 hybrid_clock.cc:648] HybridClock initialized: now 1786517908226786 us; error 53 us; skew 500 ppm
I20260812 06:58:28.227154 2844 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:28 dist-test-slave-tc2s krb5kdc[2205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517908, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:28.230077 2844 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:58:28.231415 2844 webserver.cc:460] Webserver started at http://127.18.70.131:36863/ using document root <none> and password file <none>
I20260812 06:58:28.232059 2844 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:28.232175 2844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:28.232483 2844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:28.235298 2844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "46ece14dd10b48daa64486d2888f057f"
format_stamp: "Formatted at 2026-08-12 06:58:28 on dist-test-slave-tc2s"
server_key: "5409a0b66dcf6c608fc76742aa5ba8ba"
server_key_iv: "146f393a8a15a0cba01119b8bd709f66"
server_key_version: "encryptionkey@0"
I20260812 06:58:28.236073 2844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "46ece14dd10b48daa64486d2888f057f"
format_stamp: "Formatted at 2026-08-12 06:58:28 on dist-test-slave-tc2s"
server_key: "5409a0b66dcf6c608fc76742aa5ba8ba"
server_key_iv: "146f393a8a15a0cba01119b8bd709f66"
server_key_version: "encryptionkey@0"
I20260812 06:58:28.240899 2844 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 06:58:28.244168 2871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:28.245417 2844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 06:58:28.245560 2844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "46ece14dd10b48daa64486d2888f057f"
format_stamp: "Formatted at 2026-08-12 06:58:28 on dist-test-slave-tc2s"
server_key: "5409a0b66dcf6c608fc76742aa5ba8ba"
server_key_iv: "146f393a8a15a0cba01119b8bd709f66"
server_key_version: "encryptionkey@0"
I20260812 06:58:28.245738 2844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:28.277770 2844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:28.281490 2844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:28.281750 2844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:28.282855 2844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:28.284243 2844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:28.284324 2844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:28.284451 2844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:28.284499 2844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:28.314741 2844 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:42739
I20260812 06:58:28.314782 3060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:42739 every 8 connection(s)
I20260812 06:58:28.315889 2844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:58:28.323829 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 2844
I20260812 06:58:28.324015 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:58:28.324446 18714 external_mini_cluster.cc:1428] Setting key 7e238a9c47e5464aa5ed4d6880718290
Aug 12 06:58:28 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517908, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:28.332267 2611 heartbeater.cc:503] Master 127.18.70.190:38933 was elected leader, sending a full tablet report...
I20260812 06:58:28.334192 2617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:28.318240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:56199 (local address 127.18.70.190:38933)
0812 06:58:28.318413 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:28.318418 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:28.319465 (+ 1047us) server_negotiation.cc:407] Connection header received
0812 06:58:28.321194 (+ 1729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:28.321199 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:28.321271 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:28.321357 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:28.322767 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:28.323600 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:28.325232 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:28.325663 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:28.325774 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:28.329041 (+ 3267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:28.329045 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:28.329049 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:28.329080 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:28.331410 (+ 2330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:28.332086 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:28.332090 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:28.332093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:28.332216 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:28.332638 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:28.332642 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:28.332644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:28.332934 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:28.333077 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:28.333723 (+ 646us) server_negotiation.cc:299] Negotiation successful
0812 06:58:28.333932 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 06:58:28.335031 3063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:28.318669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:56199)
0812 06:58:28.319310 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:28.319345 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:28.320950 (+ 1605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:28.321543 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:28.321550 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:28.322098 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:28.322628 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:28.322645 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:28.323731 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:28.323734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:28.325072 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:28.325089 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:28.325912 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:28.325922 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:28.326126 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:28.326720 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:28.326755 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:28.328842 (+ 2087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:28.331534 (+ 2692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:28.331542 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:28.331556 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:28.331956 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:28.332319 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:28.332324 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:28.332328 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:28.332531 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:28.333057 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:28.333062 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:28.333341 (+ 279us) client_negotiation.cc:769] Sending connection context
0812 06:58:28.333606 (+ 265us) client_negotiation.cc:240] Negotiation successful
0812 06:58:28.334061 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":263,"threads_started":1}
I20260812 06:58:28.336196 3061 heartbeater.cc:347] Connected to a master server at 127.18.70.190:38933
I20260812 06:58:28.336454 3061 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:28.337108 3061 heartbeater.cc:511] Master 127.18.70.190:38933 requested a full tablet report, sending...
I20260812 06:58:28.338517 2277 ts_manager.cc:194] Registered new tserver with Master: 46ece14dd10b48daa64486d2888f057f (127.18.70.131:42739)
I20260812 06:58:28.339430 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:58:28.339540 2277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:56199
WARNING: no policy specified for oryx/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab.
Entry for principal oryx/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab.
WARNING: no policy specified for oryx/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab.
Entry for principal oryx/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab.
WARNING: no policy specified for oryx/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab.
Entry for principal oryx/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab.
I20260812 06:58:28.464097 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 2391
Aug 12 06:58:28 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:58:28.479106 3081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:28.465245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40672 (local address 127.18.70.129:45893)
0812 06:58:28.465886 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:28.465925 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:28.465959 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:58:28.466034 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:28.466041 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:28.466253 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:28.466407 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:28.467641 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:28.468652 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:28.469755 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:28.470355 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:28.470456 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:28.474091 (+ 3635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:28.474103 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:28.474118 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:28.474158 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:28.476844 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:28.477406 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:28.477412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:28.477414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:28.477542 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:28.477804 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:28.477807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:28.477809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:28.478166 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:28.478399 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:28.478613 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 06:58:28.478820 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":295,"threads_started":1}
I20260812 06:58:28.480346 2605 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:28.572969 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 2391
I20260812 06:58:28.593936 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 2621
Aug 12 06:58:28 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 06:58:28.609103 3083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:28.594720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59706 (local address 127.18.70.130:39209)
0812 06:58:28.595221 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:28.595229 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:28.595256 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:58:28.595320 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:28.595326 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:28.595536 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:28.595664 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:28.596865 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:28.597842 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:28.599291 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:28.599817 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:28.599921 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:28.603996 (+ 4075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:28.604007 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:28.604021 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:28.604062 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:28.606809 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:28.607424 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:28.607430 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:28.607432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:28.607551 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:28.607801 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:28.607804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:28.607806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:28.608134 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:28.608366 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:28.608609 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 06:58:28.608804 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":250,"threads_started":1}
I20260812 06:58:28.610400 2831 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:28.690886 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 2621
I20260812 06:58:28.716358 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 2844
Aug 12 06:58:28 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 06:58:28.731997 3090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:28.717293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33314 (local address 127.18.70.131:42739)
0812 06:58:28.717852 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:28.717859 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:28.717919 (+ 60us) server_negotiation.cc:407] Connection header received
0812 06:58:28.717989 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:28.717995 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:28.718212 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:28.718376 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:28.719696 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:28.720743 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:28.722072 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:28.722638 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:28.722753 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:28.726789 (+ 4036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:28.726800 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:28.726815 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:28.726848 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:28.729282 (+ 2434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:28.730010 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:28.730017 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:28.730020 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:28.730143 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:28.730502 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:28.730507 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:28.730510 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:28.730844 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:28.731155 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:28.731441 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 06:58:28.731693 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":254,"threads_started":1}
I20260812 06:58:28.733177 3050 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:28.813288 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 2844
I20260812 06:58:28.829551 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 2226
I20260812 06:58:28.830780 2338 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:28.931533 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 2226
I20260812 06:58:28.956243 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:38933
--webserver_interface=127.18.70.190
--webserver_port=36195
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:38933
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:29.276077 3098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:29.276384 3098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:29.276522 3098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:29.283537 3098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:58:29.283648 3098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:29.283730 3098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:29.283811 3098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:58:29.283874 3098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:58:29.293308 3098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:38933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:38933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=36195
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:29.294546 3098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:29.295768 3098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:29.307076 3113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:29.307135 3109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:29.307044 3107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:29.308255 3098 server_base.cc:1034] running on GCE node
I20260812 06:58:29.309021 3098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:29.310292 3098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:29.311493 3098 hybrid_clock.cc:648] HybridClock initialized: now 1786517909311450 us; error 32 us; skew 500 ppm
I20260812 06:58:29.311811 3098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:29 dist-test-slave-tc2s krb5kdc[2205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517909, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:29.314808 3098 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:58:29.316174 3098 webserver.cc:460] Webserver started at http://127.18.70.190:36195/ using document root <none> and password file <none>
I20260812 06:58:29.316780 3098 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:29.316895 3098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:29.321874 3098 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260812 06:58:29.324451 3125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:29.325618 3098 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 06:58:29.325764 3098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "99edae990e364968a61c11a4d2f1c788"
format_stamp: "Formatted at 2026-08-12 06:58:26 on dist-test-slave-tc2s"
server_key: "f0594d7580f1d1b846fd5631bb950d86"
server_key_iv: "484e33f7650d2b8be406331de9ec9919"
server_key_version: "encryptionkey@0"
I20260812 06:58:29.326696 3098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:29.358390 3098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:29.362569 3098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:29.362812 3098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:29.380213 3098 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:38933
I20260812 06:58:29.380231 3211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:38933 every 8 connection(s)
I20260812 06:58:29.381651 3098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:58:29.386505 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 3098
I20260812 06:58:29.387458 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:45893
--local_ip_for_outbound_sockets=127.18.70.129
--tserver_master_addrs=127.18.70.190:38933
--webserver_port=43621
--webserver_interface=127.18.70.129
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.70.129
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:58:29.389129 3213 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:58:29.393282 3213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788: Bootstrap starting.
I20260812 06:58:29.414063 3213 log.cc:824] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:29.422663 3213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:58:29.423169 3213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788: Bootstrap complete.
I20260812 06:58:29.431993 3213 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } }
I20260812 06:58:29.432780 3213 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99edae990e364968a61c11a4d2f1c788, State: Initialized, Role: FOLLOWER
I20260812 06:58:29.433347 3213 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } }
I20260812 06:58:29.433568 3213 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:58:29.433673 3213 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:58:29.433835 3213 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:58:29.437417 3213 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } }
I20260812 06:58:29.437870 3213 leader_election.cc:302] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99edae990e364968a61c11a4d2f1c788; no voters:
I20260812 06:58:29.438539 3213 leader_election.cc:288] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:58:29.438678 3218 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:58:29.439750 3218 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [term 2 LEADER]: Becoming Leader. State: Replica: 99edae990e364968a61c11a4d2f1c788, State: Running, Role: LEADER
I20260812 06:58:29.440357 3218 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } }
I20260812 06:58:29.440629 3213 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:58:29.442907 3222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99edae990e364968a61c11a4d2f1c788. Latest consensus state: current_term: 2 leader_uuid: "99edae990e364968a61c11a4d2f1c788" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } } }
I20260812 06:58:29.443344 3222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:29.443902 3220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "99edae990e364968a61c11a4d2f1c788" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99edae990e364968a61c11a4d2f1c788" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38933 } } }
I20260812 06:58:29.444212 3220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:29.455309 3232 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:58:29.461378 3232 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:58:29.462846 3232 catalog_manager.cc:1259] Loaded cluster ID: d8a70228040143cd864bcfb6bff8680f
I20260812 06:58:29.462994 3232 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:58:29.466933 3232 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:58:29.468411 3232 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 99edae990e364968a61c11a4d2f1c788: Loaded TSK: 0
I20260812 06:58:29.469939 3232 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:58:29.733505 3216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:29.733794 3216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:29.733973 3216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:29.741434 3216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:29.741600 3216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:29.741755 3216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:58:29.751771 3216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.129.keytab
--principal=oryx/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:45893
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=43621
--tserver_master_addrs=127.18.70.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:29.753175 3216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:29.754539 3216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:29.769299 3257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:29.769663 3260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:29.770063 3256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:29.770955 3216 server_base.cc:1034] running on GCE node
I20260812 06:58:29.771727 3216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:29.773295 3216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:29.774641 3216 hybrid_clock.cc:648] HybridClock initialized: now 1786517909774560 us; error 49 us; skew 500 ppm
I20260812 06:58:29.775146 3216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:29 dist-test-slave-tc2s krb5kdc[2205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517909, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:29.779663 3216 init.cc:377] Logged in from keytab as oryx/127.18.70.129@KRBTEST.COM (short username oryx)
I20260812 06:58:29.781510 3216 webserver.cc:460] Webserver started at http://127.18.70.129:43621/ using document root <none> and password file <none>
I20260812 06:58:29.782578 3216 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:29.782734 3216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:29.790457 3216 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 06:58:29.794371 3270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:29.796125 3216 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 06:58:29.796303 3216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "5f4eec70648546c7a26c3739f078f4fc"
format_stamp: "Formatted at 2026-08-12 06:58:27 on dist-test-slave-tc2s"
server_key: "51ef4862c29b0ff661a0231438549bf0"
server_key_iv: "5585de1be54ffdfab0a6d575f993d14e"
server_key_version: "encryptionkey@0"
I20260812 06:58:29.797793 3216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:29.818359 3216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:29.822965 3216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:29.823235 3216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:29.824340 3216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:29.825755 3216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:29.825858 3216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:29.825989 3216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:29.826076 3216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:29.856817 3216 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:45893
I20260812 06:58:29.856886 3478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:45893 every 8 connection(s)
I20260812 06:58:29.858353 3216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:58:29.865506 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 3216
I20260812 06:58:29.866302 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:39209
--local_ip_for_outbound_sockets=127.18.70.130
--tserver_master_addrs=127.18.70.190:38933
--webserver_port=41537
--webserver_interface=127.18.70.130
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.70.130
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:58:29 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:29 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:58:30.202453 3485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:30.202733 3485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:30.202867 3485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:30.210247 3485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:30.210367 3485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:30.210516 3485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:58:30.220432 3485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.130.keytab
--principal=oryx/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:39209
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=41537
--tserver_master_addrs=127.18.70.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:30.221755 3485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:30.223145 3485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:30.236634 3495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:30.236609 3496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:30.237246 3499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:30.237792 3485 server_base.cc:1034] running on GCE node
I20260812 06:58:30.238412 3485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:30.239343 3485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:30.240571 3485 hybrid_clock.cc:648] HybridClock initialized: now 1786517910240512 us; error 46 us; skew 500 ppm
I20260812 06:58:30.240887 3485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:30 dist-test-slave-tc2s krb5kdc[2205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517910, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:30.244227 3485 init.cc:377] Logged in from keytab as oryx/127.18.70.130@KRBTEST.COM (short username oryx)
I20260812 06:58:30.245668 3485 webserver.cc:460] Webserver started at http://127.18.70.130:41537/ using document root <none> and password file <none>
I20260812 06:58:30.246366 3485 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:30.246505 3485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:30.252156 3485 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 06:58:30.254853 3509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:30.256239 3485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:58:30.256381 3485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "a725b2d04d1642c5b51197fc301561ef"
format_stamp: "Formatted at 2026-08-12 06:58:27 on dist-test-slave-tc2s"
server_key: "689951b7f28f57b8a4ee113a03cbc541"
server_key_iv: "db99c0214e7460c165e95ce8ac5e33e2"
server_key_version: "encryptionkey@0"
I20260812 06:58:30.257290 3485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:30.275506 3485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:30.279436 3485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:30.279680 3485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:30.280691 3485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:30.282125 3485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:30.282227 3485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:30.282327 3485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:30.282394 3485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:30.323486 3485 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:39209
I20260812 06:58:30.323526 3718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:39209 every 8 connection(s)
I20260812 06:58:30.324952 3485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:58:30.334748 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 3485
I20260812 06:58:30.335469 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:42739
--local_ip_for_outbound_sockets=127.18.70.131
--tserver_master_addrs=127.18.70.190:38933
--webserver_port=36863
--webserver_interface=127.18.70.131
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.70.131
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:58:30 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:30 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:58:30.878401 3726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:30.878847 3726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:30.879078 3726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:30.892199 3726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:30.892367 3726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:30.892593 3726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
W20260812 06:58:30.905128 3484 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.033s user 0.001s sys 0.015s
W20260812 06:58:30.907217 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:29.861465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:34871 (local address 127.18.70.190:38933)
0812 06:58:29.862336 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:29.862353 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:29.862564 (+ 211us) server_negotiation.cc:407] Connection header received
0812 06:58:29.864750 (+ 2186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:29.864761 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:29.865071 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:29.865377 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:29.867081 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:29.868327 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:29.869848 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:29.870516 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:29.870681 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:30.906393 (+1035712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:34871: BlockingRecv error: recv got EOF from 127.18.70.129:34871 (error 108)
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":304,"threads_started":1}
I20260812 06:58:30.907219 3484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:29.861504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:34871)
0812 06:58:29.862388 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:29.862435 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:29.864225 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:29.865554 (+ 1329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:29.865564 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:29.866270 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:29.866869 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:29.866887 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:29.868489 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:29.868494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:29.869709 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:29.869721 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:29.870738 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:29.870746 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:29.871017 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:29.871649 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:29.871672 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:30.905969 (+1034297us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":377,"threads_started":1}
W20260812 06:58:30.908594 3479 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:38933 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.70.190:38933: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
I20260812 06:58:30.910650 3726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/krb5kdc/oryx_127.18.70.131.keytab
--principal=oryx/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:42739
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=36863
--tserver_master_addrs=127.18.70.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:30.912593 3726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:30.914577 3726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 12 06:58:30 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:30 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:30.918470 3484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:30.909355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:59665)
0812 06:58:30.909740 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:30.909759 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:30.909919 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:30.910262 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:30.910267 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:30.910662 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:30.910855 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:30.910867 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.911975 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.911984 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:30.913019 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:30.913033 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.913810 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.913817 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:30.914002 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:30.914590 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:30.914609 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:30.918173 (+ 3564us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270}
W20260812 06:58:30.918618 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:30.909555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:59665 (local address 127.18.70.190:38933)
0812 06:58:30.909727 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:30.909733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:30.909827 (+ 94us) server_negotiation.cc:407] Connection header received
0812 06:58:30.910056 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:30.910060 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:30.910126 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:30.910213 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:30.911071 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.911818 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.913160 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.913632 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.913747 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:30.918399 (+ 4652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:59665: BlockingRecv error: recv got EOF from 127.18.70.129:59665 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 06:58:30 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:30 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:30.927851 3484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:30.919379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:44367)
0812 06:58:30.919719 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:30.919733 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:30.919838 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:30.920183 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:30.920188 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:30.920546 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:30.920701 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:30.920710 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.921733 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.921738 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:30.922743 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:30.922755 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.923427 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.923433 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:30.923621 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:30.924188 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:30.924206 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:30.927574 (+ 3368us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249}
W20260812 06:58:30.928349 3479 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:58:30.928758 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:30.919460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:44367 (local address 127.18.70.190:38933)
0812 06:58:30.919612 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:30.919616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:30.919801 (+ 185us) server_negotiation.cc:407] Connection header received
0812 06:58:30.919968 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:30.919973 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:30.920052 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:30.920131 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:30.920853 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.921595 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.922888 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.923281 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.923393 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:30.928548 (+ 5155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:44367: BlockingRecv error: recv got EOF from 127.18.70.129:44367 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260812 06:58:30.933580 3736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:30.934899 3737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:30.939684 3739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:30.939821 3726 server_base.cc:1034] running on GCE node
I20260812 06:58:30.940553 3726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:30.941610 3726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:30.942816 3726 hybrid_clock.cc:648] HybridClock initialized: now 1786517910942730 us; error 79 us; skew 500 ppm
I20260812 06:58:30.943141 3726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:30 dist-test-slave-tc2s krb5kdc[2205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517910, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:30.946424 3726 init.cc:377] Logged in from keytab as oryx/127.18.70.131@KRBTEST.COM (short username oryx)
I20260812 06:58:30.948104 3726 webserver.cc:460] Webserver started at http://127.18.70.131:36863/ using document root <none> and password file <none>
I20260812 06:58:30.948853 3726 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:30.948982 3726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:30.954975 3726 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 06:58:30.958310 3751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:30.960036 3726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 06:58:30.960202 3726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "46ece14dd10b48daa64486d2888f057f"
format_stamp: "Formatted at 2026-08-12 06:58:28 on dist-test-slave-tc2s"
server_key: "5409a0b66dcf6c608fc76742aa5ba8ba"
server_key_iv: "146f393a8a15a0cba01119b8bd709f66"
server_key_version: "encryptionkey@0"
I20260812 06:58:30.961251 3726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:30.978626 3726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:30.983307 3726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:30.983552 3726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:30.984596 3726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:30.986069 3726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:30.986179 3726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:30.986287 3726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:30.986368 3726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:31.022826 3726 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:42739
I20260812 06:58:31.022863 3950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:42739 every 8 connection(s)
I20260812 06:58:31.024255 3726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:58:31.026001 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 3726
Aug 12 06:58:31 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:31 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:31.063936 3957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:31.027399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46832 (local address 127.18.70.190:38933)
0812 06:58:31.043317 (+ 15918us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:31.043325 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:31.046463 (+ 3138us) server_negotiation.cc:407] Connection header received
0812 06:58:31.046594 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:31.046599 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:31.046689 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:31.046801 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:31.048411 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.049379 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.050704 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.051102 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.051214 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:31.054078 (+ 2864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:31.054086 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:31.054100 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:31.054142 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:31.057281 (+ 3139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:31.057940 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:31.057951 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:31.057961 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:31.058200 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:31.061968 (+ 3768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:31.061972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:31.061974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:31.062475 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:31.062786 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:31.063217 (+ 431us) server_negotiation.cc:299] Negotiation successful
0812 06:58:31.063608 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15743,"spinlock_wait_cycles":18176,"thread_start_us":16754,"threads_started":1}
W20260812 06:58:31.437036 3724 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.099s user 0.000s sys 0.014s
W20260812 06:58:31.438592 3721 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:30.327645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:48895 (local address 127.18.70.190:38933)
0812 06:58:30.328062 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:30.328067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:30.329418 (+ 1351us) server_negotiation.cc:407] Connection header received
0812 06:58:30.331470 (+ 2052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:30.331476 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:30.331560 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:30.331651 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:30.333138 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.333877 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.336118 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.336885 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.337027 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:31.438296 (+1101269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:48895: BlockingRecv error: recv got EOF from 127.18.70.130:48895 (error 108)
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":210,"threads_started":1}
I20260812 06:58:31.439499 3724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:30.328397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:48895)
0812 06:58:30.329268 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:30.329306 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:30.331196 (+ 1890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:30.331935 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:30.331944 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:30.332436 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:30.332974 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:30.332991 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.334062 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.334069 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:30.335915 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:30.335931 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:30.337130 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:30.337137 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:30.337400 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:30.338229 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:30.338258 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:31.438149 (+1099891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":351,"threads_started":1}
W20260812 06:58:31.440524 3719 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:38933 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.70.190:38933: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Aug 12 06:58:31 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:31 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:31.451517 3724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:31.441169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:44289)
0812 06:58:31.441443 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:31.441467 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:31.441621 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:31.441973 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:31.441979 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:31.442511 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:31.442756 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:31.442769 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.443785 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.443791 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:31.445459 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:31.445477 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.446327 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.446334 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:31.446517 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:31.447148 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:31.447168 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:31.451180 (+ 4012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":64}
W20260812 06:58:31.451534 3721 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:31.441256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:44289 (local address 127.18.70.190:38933)
0812 06:58:31.441417 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:31.441422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:31.441542 (+ 120us) server_negotiation.cc:407] Connection header received
0812 06:58:31.441743 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:31.441747 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:31.441809 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:31.441885 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:31.442887 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.443650 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.445594 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.446130 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.446252 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:31.451342 (+ 5090us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:44289: BlockingRecv error: recv got EOF from 127.18.70.130:44289 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 12 06:58:31 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:31 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:31.461985 3724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:31.452194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:36073)
0812 06:58:31.452347 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:31.452364 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:31.452453 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:31.452951 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:31.452954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:31.453225 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:31.453379 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:31.453387 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.454913 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.454917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:31.456345 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:31.456359 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.457339 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.457343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:31.457528 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:31.458340 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:31.458358 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:31.461679 (+ 3321us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 06:58:31.462218 3721 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:31.452460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:36073 (local address 127.18.70.190:38933)
0812 06:58:31.452639 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:31.452645 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:31.452665 (+ 20us) server_negotiation.cc:407] Connection header received
0812 06:58:31.452721 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:31.452726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:31.452814 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:31.452933 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:31.453512 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.454774 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.456496 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.457205 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.457338 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:31.461975 (+ 4637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:36073: BlockingRecv error: recv got EOF from 127.18.70.130:36073 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 06:58:31.462419 3719 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 06:58:31 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:31 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:31.944336 3967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:31.928890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:33905)
0812 06:58:31.929459 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:31.929476 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:31.929608 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:31.930065 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:31.930072 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:31.930798 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:31.931074 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:31.931090 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.932187 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.932192 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:31.933519 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:31.933535 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.934516 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.934520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:31.934637 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:31.940161 (+ 5524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:31.940182 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:31.944053 (+ 3871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":310,"threads_started":1}
W20260812 06:58:31.944644 3721 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:31.928978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:33905 (local address 127.18.70.190:38933)
0812 06:58:31.929183 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:31.929191 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:31.929556 (+ 365us) server_negotiation.cc:407] Connection header received
0812 06:58:31.929713 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:31.929717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:31.929840 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:31.929975 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:31.931230 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.932030 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.933681 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.934212 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.934284 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:31.944365 (+ 10081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:33905: BlockingRecv error: recv got EOF from 127.18.70.129:33905 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 06:58:32.058485 3961 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.004s user 0.008s sys 0.012s
W20260812 06:58:32.059696 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:31.026917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:57775 (local address 127.18.70.190:38933)
0812 06:58:31.027146 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:31.027152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:31.044140 (+ 16988us) server_negotiation.cc:407] Connection header received
0812 06:58:31.046776 (+ 2636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:31.046782 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:31.046900 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:31.047026 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:31.048789 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.050089 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.052750 (+ 2661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.053427 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.053552 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:32.059425 (+1005873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:57775: BlockingRecv error: recv got EOF from 127.18.70.131:57775 (error 108)
Metrics: {"server-negotiator.queue_time_us":88,"spinlock_wait_cycles":41472}
I20260812 06:58:32.060321 3961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:31.027495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:57775)
0812 06:58:31.043944 (+ 16449us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:31.043998 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:31.046445 (+ 2447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:31.047290 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:31.047298 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:31.047872 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:31.048576 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:31.048602 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.050323 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.050329 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:31.052573 (+ 2244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:31.052591 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:31.053671 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:31.053678 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:31.054035 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:31.054795 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:31.054826 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:32.059255 (+1004429us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":16124,"thread_start_us":15901,"threads_started":1}
W20260812 06:58:32.061298 3951 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:38933 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.70.190:38933: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Aug 12 06:58:32 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:32 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:32.070425 3961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:32.061883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:42873)
0812 06:58:32.062121 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:32.062143 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:32.062257 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:32.062560 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:32.062563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:32.062901 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:32.063074 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:32.063081 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.064319 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.064323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:32.065419 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:32.065433 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.066206 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.066213 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:32.066367 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:32.066945 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:32.066962 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:32.070137 (+ 3175us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":69}
W20260812 06:58:32.070585 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:32.062078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:42873 (local address 127.18.70.190:38933)
0812 06:58:32.062315 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:32.062320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:32.062337 (+ 17us) server_negotiation.cc:407] Connection header received
0812 06:58:32.062387 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:32.062391 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:32.062456 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:32.062530 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:32.063224 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.064181 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.065555 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.066029 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.066150 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:32.070347 (+ 4197us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:42873: BlockingRecv error: recv got EOF from 127.18.70.131:42873 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 12 06:58:32 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:32 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:32.078617 3961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:32.071054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:43977)
0812 06:58:32.071211 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:32.071229 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:32.071306 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:32.071547 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:32.071550 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:32.071827 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:32.071987 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:32.071995 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.072855 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.072858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:32.073782 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:32.073793 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.074435 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.074439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:32.074564 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:32.075124 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:32.075145 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:32.078342 (+ 3197us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 06:58:32.078756 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:32.071123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:43977 (local address 127.18.70.190:38933)
0812 06:58:32.071253 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:32.071257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:32.071272 (+ 15us) server_negotiation.cc:407] Connection header received
0812 06:58:32.071377 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:32.071380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:32.071440 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:32.071517 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:32.072087 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.072762 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.073880 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.074291 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.074379 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:32.078542 (+ 4163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:43977: BlockingRecv error: recv got EOF from 127.18.70.131:43977 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260812 06:58:32.078938 3951 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 06:58:32 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:32 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:32.471792 3970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:32.463020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:39637)
0812 06:58:32.463554 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:32.463570 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:32.463702 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:32.464019 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:32.464024 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:32.464509 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:32.464694 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:32.464708 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.465684 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.465688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:32.466675 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:32.466689 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.467409 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.467416 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:32.467604 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:32.468185 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:32.468203 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:32.471473 (+ 3270us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":286,"threads_started":1}
W20260812 06:58:32.471951 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:32.463098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:39637 (local address 127.18.70.190:38933)
0812 06:58:32.463282 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:32.463289 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:32.463652 (+ 363us) server_negotiation.cc:407] Connection header received
0812 06:58:32.463822 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:32.463826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:32.463891 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:32.463970 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:32.464833 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.465547 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.466821 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.467234 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.467350 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:32.471701 (+ 4351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:39637: BlockingRecv error: recv got EOF from 127.18.70.130:39637 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 06:58:32 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:32 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:32.954305 3971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:32.945330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:44741)
0812 06:58:32.945808 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:32.945824 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:32.945971 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:32.946242 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:32.946245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:32.946651 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:32.946843 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:32.946852 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.947803 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.947808 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:32.948730 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:32.948743 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.949561 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.949565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:32.949695 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:32.950276 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:32.950295 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:32.954017 (+ 3722us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":260,"threads_started":1}
W20260812 06:58:32.954422 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:32.945428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:44741 (local address 127.18.70.190:38933)
0812 06:58:32.945583 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:32.945589 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:32.945921 (+ 332us) server_negotiation.cc:407] Connection header received
0812 06:58:32.946064 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:32.946068 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:32.946133 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:32.946213 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:32.946951 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.947664 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.948896 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:32.949416 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:32.949515 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:32.954206 (+ 4691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:44741: BlockingRecv error: recv got EOF from 127.18.70.129:44741 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 06:58:33 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:33 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:33.089294 3972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:33.079464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:41015)
0812 06:58:33.079987 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:33.080003 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:33.080120 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:33.080426 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:33.080430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:33.080930 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:33.081091 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:33.081101 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.082131 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.082135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:33.083248 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:33.083263 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.084158 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.084164 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:33.084290 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:33.084954 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:33.084978 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:33.089034 (+ 4056us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":297,"threads_started":1}
W20260812 06:58:33.089469 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:33.079529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:41015 (local address 127.18.70.190:38933)
0812 06:58:33.079768 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:33.079775 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:33.080076 (+ 301us) server_negotiation.cc:407] Connection header received
0812 06:58:33.080211 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:33.080215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:33.080303 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:33.080378 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:33.081205 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.082005 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.083401 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.083961 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.084077 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:33.089228 (+ 5151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:41015: BlockingRecv error: recv got EOF from 127.18.70.131:41015 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 06:58:33 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:33 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:33.481325 3973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:33.472739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:44923)
0812 06:58:33.473201 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:33.473217 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:33.473344 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:33.473607 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:33.473611 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:33.474044 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:33.474235 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:33.474245 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.475253 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.475257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:33.476172 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:33.476184 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.476825 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.476829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:33.476953 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:33.477492 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:33.477509 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:33.480969 (+ 3460us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":268,"threads_started":1}
W20260812 06:58:33.481494 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:33.472821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:44923 (local address 127.18.70.190:38933)
0812 06:58:33.473050 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:33.473057 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:33.473288 (+ 231us) server_negotiation.cc:407] Connection header received
0812 06:58:33.473432 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:33.473435 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:33.473499 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:33.473571 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:33.474362 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.475112 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.476301 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.476707 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.476798 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:33.481215 (+ 4417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:44923: BlockingRecv error: recv got EOF from 127.18.70.130:44923 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 12 06:58:33 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:33 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:33.964509 3974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:33.955390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:40745)
0812 06:58:33.955943 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:33.955960 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:33.956090 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:33.956412 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:33.956422 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:33.956876 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:33.957059 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:33.957068 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.958153 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.958158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:33.959060 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:33.959073 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.959777 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.959783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:33.959967 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:33.960630 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:33.960655 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:33.964175 (+ 3520us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":286,"threads_started":1}
W20260812 06:58:33.964648 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:33.955594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:40745 (local address 127.18.70.190:38933)
0812 06:58:33.955808 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:33.955815 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:33.956032 (+ 217us) server_negotiation.cc:407] Connection header received
0812 06:58:33.956213 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:33.956217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:33.956285 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:33.956361 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:33.957206 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.958021 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.959195 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:33.959637 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:33.959741 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:33.964415 (+ 4674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:40745: BlockingRecv error: recv got EOF from 127.18.70.129:40745 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 06:58:34 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:34 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:34.099695 3975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:34.090416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:57255)
0812 06:58:34.091344 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:34.091363 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:34.091598 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:34.091955 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:34.091961 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:34.092357 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:34.092548 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:34.092558 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.093611 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.093618 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:34.094602 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:34.094615 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.095321 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.095327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:34.095495 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:34.096031 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:34.096048 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:34.099442 (+ 3394us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":797,"thread_start_us":681,"threads_started":1}
W20260812 06:58:34.099848 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:34.091124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:57255 (local address 127.18.70.190:38933)
0812 06:58:34.091318 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:34.091324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:34.091438 (+ 114us) server_negotiation.cc:407] Connection header received
0812 06:58:34.091721 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:34.091726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:34.091810 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:34.091888 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:34.092700 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.093463 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.094736 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.095170 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.095280 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:34.099631 (+ 4351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:57255: BlockingRecv error: recv got EOF from 127.18.70.131:57255 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 06:58:34 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:34 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:34.490916 3976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:34.482467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:55761)
0812 06:58:34.482978 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:34.482995 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:34.483126 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:34.483438 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:34.483444 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:34.483841 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:34.484034 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:34.484044 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.485060 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.485064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:34.485997 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:34.486010 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.486699 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.486704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:34.486872 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:34.487426 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:34.487444 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:34.490576 (+ 3132us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":254,"threads_started":1}
W20260812 06:58:34.491065 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:34.482537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:55761 (local address 127.18.70.190:38933)
0812 06:58:34.482728 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:34.482734 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:34.483078 (+ 344us) server_negotiation.cc:407] Connection header received
0812 06:58:34.483247 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:34.483252 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:34.483312 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:34.483392 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:34.484182 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.484928 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.486140 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.486556 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.486669 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:34.490806 (+ 4137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:55761: BlockingRecv error: recv got EOF from 127.18.70.130:55761 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 12 06:58:34 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:34 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:34.974275 3977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:34.965453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:39563)
0812 06:58:34.966023 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:34.966039 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:34.966172 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:34.966536 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:34.966541 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:34.967030 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:34.967207 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:34.967216 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.968325 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.968331 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:34.969315 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:34.969328 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.970027 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.970033 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:34.970218 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:34.970731 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:34.970749 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:34.973923 (+ 3174us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":293,"threads_started":1}
W20260812 06:58:34.974357 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:34.965540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:39563 (local address 127.18.70.190:38933)
0812 06:58:34.965738 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:34.965745 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:34.966115 (+ 370us) server_negotiation.cc:407] Connection header received
0812 06:58:34.966320 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:34.966325 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:34.966395 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:34.966474 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:34.967358 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.968193 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.969452 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:34.969867 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:34.970003 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:34.974145 (+ 4142us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:39563: BlockingRecv error: recv got EOF from 127.18.70.129:39563 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 06:58:35 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:35 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:35.109287 3978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:35.100649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:33327)
0812 06:58:35.101133 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:35.101149 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:35.101264 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:35.101542 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:35.101545 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:35.101935 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:35.102115 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:35.102125 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.103110 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.103114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:35.104064 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:35.104078 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.104730 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.104736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:35.104876 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:35.105551 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:35.105574 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:35.109047 (+ 3473us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":243,"threads_started":1}
W20260812 06:58:35.109453 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:35.100706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:33327 (local address 127.18.70.190:38933)
0812 06:58:35.100930 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:35.100936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:35.101224 (+ 288us) server_negotiation.cc:407] Connection header received
0812 06:58:35.101368 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:35.101372 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:35.101437 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:35.101516 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:35.102226 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.102974 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.104189 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.104594 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.104681 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:35.109237 (+ 4556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:33327: BlockingRecv error: recv got EOF from 127.18.70.131:33327 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 12 06:58:35 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:35 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:35.502094 3979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:35.492204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:53775)
0812 06:58:35.492848 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:35.492868 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:35.493018 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:35.493400 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:35.493406 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:35.493953 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:35.494201 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:35.494213 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.495383 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.495388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:35.496466 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:35.496479 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.497339 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.497344 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:35.497502 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:35.498266 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:35.498291 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:35.501713 (+ 3422us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":354,"threads_started":1}
W20260812 06:58:35.502265 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:35.492259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:53775 (local address 127.18.70.190:38933)
0812 06:58:35.492531 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:35.492539 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:35.493029 (+ 490us) server_negotiation.cc:407] Connection header received
0812 06:58:35.493116 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:35.493120 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:35.493187 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:35.493273 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:35.494393 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.495243 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.496676 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.497160 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.497276 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:35.501977 (+ 4701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:53775: BlockingRecv error: recv got EOF from 127.18.70.130:53775 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 12 06:58:35 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:35 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:35.985173 3980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:35.975447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:51463)
0812 06:58:35.975972 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:35.975988 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:35.976117 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:35.976457 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:35.976462 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:35.976912 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:35.977081 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:35.977090 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.978449 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.978452 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:35.979394 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:35.979406 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.980176 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.980180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:35.980334 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:35.981044 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:35.981072 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:35.984847 (+ 3775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":260,"threads_started":1}
W20260812 06:58:35.985337 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:35.975484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:51463 (local address 127.18.70.190:38933)
0812 06:58:35.975691 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:35.975699 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:35.976070 (+ 371us) server_negotiation.cc:407] Connection header received
0812 06:58:35.976231 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:35.976234 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:35.976300 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:35.976399 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:35.977314 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.978313 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.979566 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:35.980023 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:35.980181 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:35.985100 (+ 4919us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:51463: BlockingRecv error: recv got EOF from 127.18.70.129:51463 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 12 06:58:36 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:36 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:36.120329 3982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:36.110343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:47479)
0812 06:58:36.110862 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:36.110878 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:36.110995 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:36.111295 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:36.111298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:36.111681 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:36.111847 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:36.111856 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.112957 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.112961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:36.114155 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:36.114173 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.114892 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.114896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:36.115030 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:36.115718 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:36.115750 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:36.119909 (+ 4159us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":270,"threads_started":1}
W20260812 06:58:36.120476 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:36.110405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:47479 (local address 127.18.70.190:38933)
0812 06:58:36.110574 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:36.110579 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:36.111007 (+ 428us) server_negotiation.cc:407] Connection header received
0812 06:58:36.111109 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:36.111113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:36.111179 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:36.111261 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:36.112008 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.112753 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.114341 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.114764 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.114859 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:36.120200 (+ 5341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:47479: BlockingRecv error: recv got EOF from 127.18.70.131:47479 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 06:58:36 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:36 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:36.513960 3983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:36.503225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:54235)
0812 06:58:36.503860 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:36.503881 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:36.504010 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:36.504432 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:36.504437 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:36.504987 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:36.505203 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:36.505213 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.506601 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.506607 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:36.507617 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:36.507631 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.508459 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.508464 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:36.508715 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:36.509566 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:36.509596 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:36.513689 (+ 4093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":291,"threads_started":1}
W20260812 06:58:36.514174 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:36.503504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:54235 (local address 127.18.70.190:38933)
0812 06:58:36.503735 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:36.503740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:36.504016 (+ 276us) server_negotiation.cc:407] Connection header received
0812 06:58:36.504134 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:36.504139 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:36.504222 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:36.504326 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:36.505395 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.506413 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.507802 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.508266 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.508382 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:36.513919 (+ 5537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:54235: BlockingRecv error: recv got EOF from 127.18.70.130:54235 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 06:58:36 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:36 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:36.997434 3984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:36.986087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:55327)
0812 06:58:36.986557 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:36.986575 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:36.986688 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:36.986952 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:36.986955 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:36.987346 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:36.987518 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:36.987526 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.988414 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.988417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:36.989312 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:36.989322 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.989975 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.989981 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:36.990150 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:36.993781 (+ 3631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:36.993801 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:36.997197 (+ 3396us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":244,"threads_started":1}
W20260812 06:58:36.997593 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:36.986160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:55327 (local address 127.18.70.190:38933)
0812 06:58:36.986344 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:36.986349 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:36.986637 (+ 288us) server_negotiation.cc:407] Connection header received
0812 06:58:36.986773 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:36.986776 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:36.986840 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:36.986916 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:36.987621 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.988318 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.989410 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:36.989808 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:36.989925 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:36.997360 (+ 7435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:55327: BlockingRecv error: recv got EOF from 127.18.70.129:55327 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 12 06:58:37 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:37 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:37.130352 3985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:37.121394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:56277)
0812 06:58:37.121907 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:37.121923 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:37.122053 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:37.122345 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:37.122350 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:37.122798 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:37.122954 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:37.122963 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:37.123961 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:37.123965 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:37.124877 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:37.124888 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:37.125570 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:37.125576 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:37.125729 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:37.126285 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:37.126303 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:37.130098 (+ 3795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":254,"threads_started":1}
W20260812 06:58:37.130436 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:37.121466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:56277 (local address 127.18.70.190:38933)
0812 06:58:37.121661 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:37.121667 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:37.122008 (+ 341us) server_negotiation.cc:407] Connection header received
0812 06:58:37.122158 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:37.122164 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:37.122224 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:37.122301 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:37.123088 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:37.123829 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:37.125007 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:37.125434 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:37.125542 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:37.130240 (+ 4698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:56277: BlockingRecv error: recv got EOF from 127.18.70.131:56277 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 06:58:37 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:37 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:37.523231 3987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:37.514889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:34947)
0812 06:58:37.515317 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:37.515333 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:37.515446 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:37.515708 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:37.515712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:37.516129 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:37.516296 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:37.516304 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:37.517262 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:37.517265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:37.518229 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:37.518241 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:37.518902 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:37.518906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:37.519028 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:37.519548 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:37.519565 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:37.522999 (+ 3434us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":230,"threads_started":1}
W20260812 06:58:37.523358 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:37.514948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:34947 (local address 127.18.70.190:38933)
0812 06:58:37.515172 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:37.515179 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:37.515410 (+ 231us) server_negotiation.cc:407] Connection header received
0812 06:58:37.515537 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:37.515541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:37.515603 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:37.515678 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:37.516424 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:37.517156 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:37.518332 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:37.518775 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:37.518858 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:37.523161 (+ 4303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:34947: BlockingRecv error: recv got EOF from 127.18.70.130:34947 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 06:58:37 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:37 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:38.007164 3988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:37.998451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:49619)
0812 06:58:37.998962 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:37.998978 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:37.999093 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:37.999349 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:37.999352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:37.999769 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:37.999938 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:37.999947 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.000920 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.000923 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:38.001854 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:38.001866 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.002694 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.002700 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:38.002864 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:38.003465 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:38.003489 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:38.006913 (+ 3424us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":228,"threads_started":1}
W20260812 06:58:38.007331 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:37.998523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:49619 (local address 127.18.70.190:38933)
0812 06:58:37.998715 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:37.998722 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:37.999053 (+ 331us) server_negotiation.cc:407] Connection header received
0812 06:58:37.999179 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:37.999183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:37.999245 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:37.999319 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:38.000049 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.000807 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.002039 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.002555 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.002671 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:38.007125 (+ 4454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:49619: BlockingRecv error: recv got EOF from 127.18.70.129:49619 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 06:58:38 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:38 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:38.139806 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:38.131392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:50525)
0812 06:58:38.131890 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:38.131909 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:38.132045 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:38.132353 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:38.132358 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:38.132789 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:38.132964 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:38.132974 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.133981 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.133987 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:38.134890 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:38.134903 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.135584 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.135590 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:38.135756 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:38.136272 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:38.136287 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:38.139571 (+ 3284us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":246,"threads_started":1}
W20260812 06:58:38.139967 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:38.131472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:50525 (local address 127.18.70.190:38933)
0812 06:58:38.131649 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:38.131654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:38.131992 (+ 338us) server_negotiation.cc:407] Connection header received
0812 06:58:38.132156 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:38.132161 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:38.132226 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:38.132305 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:38.133104 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.133823 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.135027 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.135436 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.135544 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:38.139756 (+ 4212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:50525: BlockingRecv error: recv got EOF from 127.18.70.131:50525 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 06:58:38 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:38 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:38.536155 3993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:38.524053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:53395)
0812 06:58:38.524627 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:38.524643 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:38.524787 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:38.525170 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:38.525174 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:38.525721 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:38.525981 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:38.525995 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.526963 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.526967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:38.527894 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:38.527905 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.528537 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.528541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:38.528650 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:38.532092 (+ 3442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:38.532110 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:38.535784 (+ 3674us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":281,"threads_started":1}
W20260812 06:58:38.536288 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:38.524133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:53395 (local address 127.18.70.190:38933)
0812 06:58:38.524384 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:38.524390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:38.524728 (+ 338us) server_negotiation.cc:407] Connection header received
0812 06:58:38.524938 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:38.524944 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:38.525024 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:38.525123 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:38.526113 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.526829 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.528009 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:38.528425 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:38.528520 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:38.536033 (+ 7513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:53395: BlockingRecv error: recv got EOF from 127.18.70.130:53395 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 06:58:39 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:39 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:39.016395 3994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:39.007982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:39817)
0812 06:58:39.008491 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:39.008507 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:39.008622 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:39.008877 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:39.008880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:39.009277 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:39.009460 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:39.009476 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.010425 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.010429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:39.011363 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:39.011376 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.011992 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.011996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:39.012109 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:39.012697 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:39.012714 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:39.016138 (+ 3424us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":241,"threads_started":1}
W20260812 06:58:39.016570 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:39.008035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:39817 (local address 127.18.70.190:38933)
0812 06:58:39.008192 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:39.008197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:39.008570 (+ 373us) server_negotiation.cc:407] Connection header received
0812 06:58:39.008707 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:39.008711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:39.008770 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:39.008845 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:39.009583 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.010307 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.011470 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.011850 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.011944 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:39.016354 (+ 4410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:39817: BlockingRecv error: recv got EOF from 127.18.70.129:39817 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 12 06:58:39 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:39 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:39.149155 3996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:39.140717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:40885)
0812 06:58:39.141305 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:39.141325 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:39.141463 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:39.141918 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:39.141924 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:39.142467 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:39.142640 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:39.142650 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.143584 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.143587 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:39.144529 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:39.144541 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.145191 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.145195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:39.145302 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:39.145816 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:39.145832 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:39.148903 (+ 3071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":254,"threads_started":1}
W20260812 06:58:39.149310 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:39.140877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:40885 (local address 127.18.70.190:38933)
0812 06:58:39.141062 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:39.141068 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:39.141395 (+ 327us) server_negotiation.cc:407] Connection header received
0812 06:58:39.141617 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:39.141623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:39.141703 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:39.141796 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:39.142763 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.143474 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.144649 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.145081 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.145170 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:39.149107 (+ 3937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:40885: BlockingRecv error: recv got EOF from 127.18.70.131:40885 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 06:58:39 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:39 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:39.551458 3997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:39.541797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:51733)
0812 06:58:39.542278 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:39.542294 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:39.542407 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:39.542845 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:39.542849 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:39.543306 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:39.543481 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:39.543490 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.544903 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.544909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:39.546320 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:39.546333 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.547027 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.547034 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:39.547192 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:39.547759 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:39.547777 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:39.551125 (+ 3348us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":257,"threads_started":1}
W20260812 06:58:39.551573 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:39.541875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:51733 (local address 127.18.70.190:38933)
0812 06:58:39.542129 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:39.542135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:39.542366 (+ 231us) server_negotiation.cc:407] Connection header received
0812 06:58:39.542511 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:39.542515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:39.542577 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:39.542647 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:39.543617 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.544738 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.546449 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:39.546858 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:39.546965 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:39.551325 (+ 4360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:51733: BlockingRecv error: recv got EOF from 127.18.70.130:51733 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 06:58:40 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:40 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:40.025512 3998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:40.017382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:49103)
0812 06:58:40.017831 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:40.017846 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:40.017987 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:40.018245 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:40.018248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:40.018631 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:40.018778 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:40.018786 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.019728 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.019731 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:40.020678 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:40.020688 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.021287 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.021291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:40.021409 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:40.021962 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:40.021979 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:40.025289 (+ 3310us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":253,"threads_started":1}
W20260812 06:58:40.025759 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:40.017419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:49103 (local address 127.18.70.190:38933)
0812 06:58:40.017648 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:40.017655 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:40.017929 (+ 274us) server_negotiation.cc:407] Connection header received
0812 06:58:40.018077 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:40.018081 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:40.018144 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:40.018218 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:40.018885 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.019625 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.020779 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.021181 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.021264 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:40.025517 (+ 4253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:49103: BlockingRecv error: recv got EOF from 127.18.70.129:49103 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 06:58:40 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:40 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:40.161062 4004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:40.150091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:56109)
0812 06:58:40.152957 (+ 2866us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:40.152973 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:40.153086 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:40.153381 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:40.153385 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:40.153862 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:40.154105 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:40.154121 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.155209 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.155213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:40.156212 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:40.156226 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.156987 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.156991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:40.157105 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:40.157614 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:40.157630 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:40.160810 (+ 3180us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2745,"thread_start_us":2639,"threads_started":1}
W20260812 06:58:40.161250 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:40.150133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:56109 (local address 127.18.70.190:38933)
0812 06:58:40.150284 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:40.150288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:40.153055 (+ 2767us) server_negotiation.cc:407] Connection header received
0812 06:58:40.153175 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:40.153178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:40.153241 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:40.153333 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:40.154247 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.155071 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.156345 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.156835 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.156931 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:40.160998 (+ 4067us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:56109: BlockingRecv error: recv got EOF from 127.18.70.131:56109 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 06:58:40 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:40 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:40.560793 4005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:40.552560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:53889)
0812 06:58:40.552981 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:40.552996 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:40.553104 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:40.553375 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:40.553379 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:40.553762 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:40.553934 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:40.553942 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.554836 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.554839 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:40.555911 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:40.555925 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.556764 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.556769 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:40.556904 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:40.557426 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:40.557443 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:40.560562 (+ 3119us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":216,"threads_started":1}
W20260812 06:58:40.560952 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:40.552623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:53889 (local address 127.18.70.190:38933)
0812 06:58:40.552846 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:40.552852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:40.553064 (+ 212us) server_negotiation.cc:407] Connection header received
0812 06:58:40.553199 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:40.553203 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:40.553264 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:40.553332 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:40.554026 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.554725 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.556035 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:40.556612 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:40.556716 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:40.560734 (+ 4018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:53889: BlockingRecv error: recv got EOF from 127.18.70.130:53889 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 12 06:58:41 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:41 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:41.034924 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:41.026341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:52161)
0812 06:58:41.026830 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:41.026846 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:41.026971 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:41.027277 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:41.027282 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:41.027672 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:41.027832 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:41.027841 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.028956 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.028960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:41.030009 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:41.030022 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.030711 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.030716 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:41.030866 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:41.031398 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:41.031415 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:41.034604 (+ 3189us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":272,"threads_started":1}
W20260812 06:58:41.035060 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:41.026435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:52161 (local address 127.18.70.190:38933)
0812 06:58:41.026646 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:41.026652 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:41.026926 (+ 274us) server_negotiation.cc:407] Connection header received
0812 06:58:41.027082 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:41.027087 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:41.027157 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:41.027235 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:41.027995 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.028804 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.030139 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.030571 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.030676 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:41.034803 (+ 4127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:52161: BlockingRecv error: recv got EOF from 127.18.70.129:52161 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 06:58:41 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:41 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:41.170553 4011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:41.162023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:44585)
0812 06:58:41.162474 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:41.162489 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:41.162615 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:41.162926 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:41.162931 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:41.163352 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:41.163499 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:41.163509 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.164524 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.164530 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:41.165506 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:41.165519 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.166256 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.166261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:41.166422 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:41.166969 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:41.166985 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:41.170226 (+ 3241us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":226,"threads_started":1}
W20260812 06:58:41.170707 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:41.162070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:44585 (local address 127.18.70.190:38933)
0812 06:58:41.162256 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:41.162262 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:41.162567 (+ 305us) server_negotiation.cc:407] Connection header received
0812 06:58:41.162727 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:41.162731 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:41.162790 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:41.162877 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:41.163634 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.164393 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.165650 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.166106 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.166205 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:41.170445 (+ 4240us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:44585: BlockingRecv error: recv got EOF from 127.18.70.131:44585 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 06:58:41 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:41 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:41.570133 4012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:41.561726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:59427)
0812 06:58:41.562248 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:41.562264 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:41.562375 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:41.562650 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:41.562653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:41.563026 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:41.563186 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:41.563195 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.564139 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.564142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:41.565177 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:41.565190 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.565827 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.565833 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:41.566003 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:41.566523 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:41.566539 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:41.569772 (+ 3233us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":312,"threads_started":1}
W20260812 06:58:41.570227 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:41.561793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:59427 (local address 127.18.70.190:38933)
0812 06:58:41.562017 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:41.562024 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:41.562336 (+ 312us) server_negotiation.cc:407] Connection header received
0812 06:58:41.562472 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:41.562476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:41.562538 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:41.562622 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:41.563293 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.564023 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.565289 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:41.565698 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:41.565809 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:41.569989 (+ 4180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:59427: BlockingRecv error: recv got EOF from 127.18.70.130:59427 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 06:58:42 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:42 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:42.046806 4013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:42.035831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:58093)
0812 06:58:42.036324 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:42.036340 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:42.036465 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:42.036765 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:42.036770 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:42.037210 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:42.037384 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:42.037393 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.038421 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.038427 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:42.039320 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:42.039333 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.040010 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.040015 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:42.040173 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:42.043433 (+ 3260us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:42.043451 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:42.046592 (+ 3141us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":279,"threads_started":1}
W20260812 06:58:42.046957 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:42.035995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:58093 (local address 127.18.70.190:38933)
0812 06:58:42.036232 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:42.036239 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:42.036413 (+ 174us) server_negotiation.cc:407] Connection header received
0812 06:58:42.036574 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:42.036578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:42.036639 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:42.036717 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:42.037525 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.038293 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.039456 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.039862 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.039972 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:42.046754 (+ 6782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:58093: BlockingRecv error: recv got EOF from 127.18.70.129:58093 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 12 06:58:42 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:42 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:42.179446 4014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:42.171402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:48097)
0812 06:58:42.171914 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:42.171930 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:42.172043 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:42.172299 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:42.172302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:42.172661 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:42.172820 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:42.172829 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.173742 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.173745 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:42.174744 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:42.174757 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.175367 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.175371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:42.175479 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:42.176001 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:42.176017 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:42.179120 (+ 3103us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":284,"threads_started":1}
W20260812 06:58:42.179535 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:42.171493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:48097 (local address 127.18.70.190:38933)
0812 06:58:42.171644 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:42.171649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:42.171994 (+ 345us) server_negotiation.cc:407] Connection header received
0812 06:58:42.172128 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:42.172131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:42.172192 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:42.172272 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:42.172939 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.173643 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.174878 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.175257 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.175351 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:42.179304 (+ 3953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:48097: BlockingRecv error: recv got EOF from 127.18.70.131:48097 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 12 06:58:42 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:42 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:42.579612 4015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:42.571064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:58695)
0812 06:58:42.571602 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:42.571617 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:42.571731 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:42.572014 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:42.572017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:42.572432 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:42.572608 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:42.572617 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.573548 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.573551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:42.574702 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:42.574715 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.575570 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.575574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:42.575689 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:42.576216 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:42.576233 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:42.579399 (+ 3166us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":339,"threads_started":1}
W20260812 06:58:42.579752 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:42.571160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:58695 (local address 127.18.70.190:38933)
0812 06:58:42.571420 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:42.571428 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:42.571688 (+ 260us) server_negotiation.cc:407] Connection header received
0812 06:58:42.571840 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:42.571843 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:42.571906 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:42.571988 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:42.572711 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.573452 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.574835 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:42.575427 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:42.575528 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:42.579534 (+ 4006us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:58695: BlockingRecv error: recv got EOF from 127.18.70.130:58695 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 12 06:58:43 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:43 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:43.056310 4018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:43.047711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:60629)
0812 06:58:43.048218 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:43.048234 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:43.048370 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:43.048682 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:43.048687 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:43.049132 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:43.049321 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:43.049331 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.050364 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.050368 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:43.051272 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:43.051285 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.052020 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.052026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:43.052181 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:43.052756 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:43.052773 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:43.055963 (+ 3190us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":274,"threads_started":1}
W20260812 06:58:43.056392 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:43.047764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:60629 (local address 127.18.70.190:38933)
0812 06:58:43.047934 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:43.047941 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:43.048318 (+ 377us) server_negotiation.cc:407] Connection header received
0812 06:58:43.048485 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:43.048488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:43.048551 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:43.048631 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:43.049464 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.050221 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.051422 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.051846 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.051954 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:43.056169 (+ 4215us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:60629: BlockingRecv error: recv got EOF from 127.18.70.129:60629 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 06:58:43 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:43 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:43.188617 4019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:43.180367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:57349)
0812 06:58:43.180885 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:43.180904 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:43.181019 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:43.181271 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:43.181274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:43.181669 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:43.181858 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:43.181866 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.182852 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.182856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:43.183761 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:43.183773 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.184392 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.184396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:43.184508 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:43.185073 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:43.185090 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:43.188325 (+ 3235us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":289,"threads_started":1}
W20260812 06:58:43.188752 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:43.180484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:57349 (local address 127.18.70.190:38933)
0812 06:58:43.180638 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:43.180642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:43.180970 (+ 328us) server_negotiation.cc:407] Connection header received
0812 06:58:43.181104 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:43.181107 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:43.181169 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:43.181246 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:43.181982 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.182715 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.183867 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.184256 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.184348 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:43.188532 (+ 4184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:57349: BlockingRecv error: recv got EOF from 127.18.70.131:57349 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 12 06:58:43 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:43 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:43.588817 4020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:43.580598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:45127)
0812 06:58:43.581164 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:43.581179 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:43.581290 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:43.581571 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:43.581574 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:43.582032 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:43.582207 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:43.582216 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.583105 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.583108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:43.584013 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:43.584024 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.584681 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.584685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:43.584802 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:43.585361 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:43.585382 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:43.588514 (+ 3132us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":311,"threads_started":1}
W20260812 06:58:43.588934 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:43.580675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:45127 (local address 127.18.70.190:38933)
0812 06:58:43.580838 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:43.580843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:43.581242 (+ 399us) server_negotiation.cc:407] Connection header received
0812 06:58:43.581389 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:43.581393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:43.581465 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:43.581542 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:43.582310 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.582994 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.584114 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:43.584552 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:43.584637 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:43.588732 (+ 4095us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:45127: BlockingRecv error: recv got EOF from 127.18.70.130:45127 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 12 06:58:44 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:44 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:44.065763 4022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:44.057259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:42537)
0812 06:58:44.057705 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:44.057720 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:44.057847 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:44.058205 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:44.058210 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:44.058629 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:44.058783 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:44.058792 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.059961 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.059967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:44.060966 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:44.060981 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.061680 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.061686 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:44.061855 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:44.062383 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:44.062400 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:44.065541 (+ 3141us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":238,"threads_started":1}
W20260812 06:58:44.065960 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:44.057333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:42537 (local address 127.18.70.190:38933)
0812 06:58:44.057523 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:44.057529 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:44.057800 (+ 271us) server_negotiation.cc:407] Connection header received
0812 06:58:44.057991 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:44.057996 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:44.058068 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:44.058149 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:44.058926 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.059827 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.061105 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.061546 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.061651 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:44.065720 (+ 4069us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:42537: BlockingRecv error: recv got EOF from 127.18.70.129:42537 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 12 06:58:44 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:44 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:44.198104 4024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:44.189560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:39503)
0812 06:58:44.190202 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:44.190219 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:44.190331 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:44.190577 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:44.190580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:44.190992 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:44.191153 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:44.191162 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.192132 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.192135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:44.193029 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:44.193039 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.193643 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.193647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:44.193768 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:44.194440 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:44.194457 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:44.197752 (+ 3295us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":399,"threads_started":1}
W20260812 06:58:44.198173 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:44.189629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:39503 (local address 127.18.70.190:38933)
0812 06:58:44.189809 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:44.189815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:44.190298 (+ 483us) server_negotiation.cc:407] Connection header received
0812 06:58:44.190421 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:44.190425 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:44.190488 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:44.190564 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:44.191276 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.192034 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.193131 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.193518 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.193600 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:44.197938 (+ 4338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:39503: BlockingRecv error: recv got EOF from 127.18.70.131:39503 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 06:58:44 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:44 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:44.598102 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:44.589758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:35137)
0812 06:58:44.590229 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:44.590248 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:44.590374 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:44.590760 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:44.590765 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:44.591192 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:44.591342 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:44.591351 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.592347 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.592353 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:44.593247 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:44.593259 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.593997 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.594003 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:44.594171 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:44.594721 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:44.594738 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:44.597829 (+ 3091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":247,"threads_started":1}
W20260812 06:58:44.598271 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:44.589936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:35137 (local address 127.18.70.190:38933)
0812 06:58:44.590124 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:44.590130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:44.590322 (+ 192us) server_negotiation.cc:407] Connection header received
0812 06:58:44.590525 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:44.590530 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:44.590627 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:44.590718 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:44.591488 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.592208 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.593387 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:44.593837 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:44.593997 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:44.598052 (+ 4055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:35137: BlockingRecv error: recv got EOF from 127.18.70.130:35137 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 06:58:45 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:45 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.129@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:45.075104 4026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:45.066969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.129:53619)
0812 06:58:45.067402 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:45.067419 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:45.067528 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:45.067777 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:45.067780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:45.068147 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:45.068330 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:45.068340 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.069265 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.069269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:45.070224 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:45.070237 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.070845 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.070849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:45.070984 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:45.071509 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:45.071525 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:45.074812 (+ 3287us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":208,"threads_started":1}
W20260812 06:58:45.075169 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:45.067062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:53619 (local address 127.18.70.190:38933)
0812 06:58:45.067283 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:45.067289 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:45.067484 (+ 195us) server_negotiation.cc:407] Connection header received
0812 06:58:45.067612 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:45.067616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:45.067675 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:45.067749 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:45.068446 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.069121 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.070327 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.070740 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.070827 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:45.075004 (+ 4177us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.129:53619: BlockingRecv error: recv got EOF from 127.18.70.129:53619 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 06:58:45 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:45 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.131@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:45.207404 4027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:45.198972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.131:40237)
0812 06:58:45.199428 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:45.199443 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:45.199569 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:45.199868 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:45.199873 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:45.200362 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:45.200550 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:45.200563 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.201806 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.201810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:45.202708 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:45.202719 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.203393 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.203397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:45.203513 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:45.204095 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:45.204112 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:45.207168 (+ 3056us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":237,"threads_started":1}
W20260812 06:58:45.207583 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:45.199047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:40237 (local address 127.18.70.190:38933)
0812 06:58:45.199316 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:45.199322 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:45.199515 (+ 193us) server_negotiation.cc:407] Connection header received
0812 06:58:45.199687 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:45.199691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:45.199750 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:45.199825 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:45.200700 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.201668 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.202847 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.203269 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.203364 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:45.207364 (+ 4000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.131:40237: BlockingRecv error: recv got EOF from 127.18.70.131:40237 (error 108)
Metrics: {"server-negotiator.queue_time_us":136}
Aug 12 06:58:45 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:58:45 dist-test-slave-tc2s krb5kdc[2205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.70.130@KRBTEST.COM for oryx/127.18.70.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:58:45.607854 4028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:45.599239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:38933 (local address 127.18.70.130:37889)
0812 06:58:45.599758 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:45.599774 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:45.599881 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:45.600154 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:45.600157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:45.600535 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:45.600724 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:45.600732 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.601710 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.601714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:45.602892 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:45.602906 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.603661 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.603667 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:45.603841 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:45.604416 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:45.604433 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:45.607604 (+ 3171us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.70.190:38933: Server oryx/127.18.70.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":283,"threads_started":1}
W20260812 06:58:45.608125 3482 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:45.599336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:37889 (local address 127.18.70.190:38933)
0812 06:58:45.599519 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:45.599523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:45.599834 (+ 311us) server_negotiation.cc:407] Connection header received
0812 06:58:45.599968 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:45.599972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:45.600048 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:45.600126 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:45.600849 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.601600 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.603043 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:45.603517 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:45.603636 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:45.607767 (+ 4131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.70.130:37889: BlockingRecv error: recv got EOF from 127.18.70.130:37889 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 06:58:46.028188 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 3216
I20260812 06:58:46.039775 4032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:46.029245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54222 (local address 127.18.70.129:45893)
0812 06:58:46.029908 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:46.029915 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:46.029942 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:58:46.030009 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:46.030016 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:46.030240 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:46.030402 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:46.031778 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:46.032805 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:46.033932 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:46.034448 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:46.034544 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:46.036882 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:46.036890 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:46.036905 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:46.036941 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:46.039283 (+ 2342us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.70.129@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 06:58:46.039559 (+ 276us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54222: Request ticket server kudu/127.18.70.129@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":334,"threads_started":1}
W20260812 06:58:46.039893 4032 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54222: Request ticket server kudu/127.18.70.129@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 06:58:46.039980 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 3216: Not authorized: Client connection negotiation failed: client connection to 127.18.70.129:45893: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.70.129@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 06:58:46.040179 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 3216
I20260812 06:58:46.066716 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 3485
I20260812 06:58:46.078213 4035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:46.067743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56594 (local address 127.18.70.130:39209)
0812 06:58:46.068471 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:46.068481 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:46.068514 (+ 33us) server_negotiation.cc:407] Connection header received
0812 06:58:46.068598 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:46.068607 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:46.068895 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:46.069116 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:46.070288 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:46.071354 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:46.072450 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:46.072978 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:46.073071 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:46.075399 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:46.075407 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:46.075420 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:46.075457 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:46.077662 (+ 2205us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.70.130@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 06:58:46.077955 (+ 293us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56594: Request ticket server kudu/127.18.70.130@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":351,"threads_started":1}
W20260812 06:58:46.078269 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 3485: Not authorized: Client connection negotiation failed: client connection to 127.18.70.130:39209: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.70.130@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 06:58:46.078326 4035 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56594: Request ticket server kudu/127.18.70.130@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 06:58:46.078449 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 3485
I20260812 06:58:46.100348 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 3726
I20260812 06:58:46.112125 4036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:46.101418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40634 (local address 127.18.70.131:42739)
0812 06:58:46.102011 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:46.102018 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:46.102044 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:58:46.102109 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:46.102115 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:46.102341 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:46.102518 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:46.103851 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:46.104872 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:46.106123 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:46.106676 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:46.106799 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:46.109110 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:46.109118 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:46.109132 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:46.109167 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:46.111472 (+ 2305us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.70.131@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 06:58:46.111799 (+ 327us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40634: Request ticket server kudu/127.18.70.131@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":265,"threads_started":1}
W20260812 06:58:46.112138 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 3726: Not authorized: Client connection negotiation failed: client connection to 127.18.70.131:42739: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.70.131@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 06:58:46.112237 4036 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40634: Request ticket server kudu/127.18.70.131@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 06:58:46.112274 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 3726
I20260812 06:58:46.140441 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 3098
I20260812 06:58:46.141626 3204 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:46.255626 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 3098
2026-08-12T06:58:46Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21423 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T06:58:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:58:46Z Disabled control of system clock
I20260812 06:58:46.335134 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:33383
--webserver_interface=127.18.70.190
--webserver_port=0
--builtin_ntp_servers=127.18.70.148:46063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:33383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 06:58:46.652083 4047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:46.652359 4047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:46.652444 4047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:46.659379 4047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:58:46.659482 4047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:46.659526 4047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:46.659580 4047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:58:46.659622 4047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:58:46.668359 4047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:33383
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:33383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:46.669555 4047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:46.671254 4047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:46.682367 4063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:46.682451 4060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:46.682425 4065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:46.683020 4047 server_base.cc:1034] running on GCE node
I20260812 06:58:46.683753 4047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:46.684988 4047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:46.686170 4047 hybrid_clock.cc:648] HybridClock initialized: now 1786517926686121 us; error 43 us; skew 500 ppm
I20260812 06:58:46.686456 4047 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:58:46.688418 4047 webserver.cc:460] Webserver started at http://127.18.70.190:41225/ using document root <none> and password file <none>
I20260812 06:58:46.689044 4047 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:46.689128 4047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:46.689390 4047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:46.692164 4047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "72594832c7dc44bfb833ffa205fbbf42"
format_stamp: "Formatted at 2026-08-12 06:58:46 on dist-test-slave-tc2s"
server_key: "fa6abbed4b7397b9b72b190fd6be21a0"
server_key_iv: "f5d3ccb7e95ba0bc1a2f366817210824"
server_key_version: "encryptionkey@0"
I20260812 06:58:46.692883 4047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "72594832c7dc44bfb833ffa205fbbf42"
format_stamp: "Formatted at 2026-08-12 06:58:46 on dist-test-slave-tc2s"
server_key: "fa6abbed4b7397b9b72b190fd6be21a0"
server_key_iv: "f5d3ccb7e95ba0bc1a2f366817210824"
server_key_version: "encryptionkey@0"
I20260812 06:58:46.697547 4047 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.006s
I20260812 06:58:46.700721 4076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:46.701885 4047 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:58:46.702072 4047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "72594832c7dc44bfb833ffa205fbbf42"
format_stamp: "Formatted at 2026-08-12 06:58:46 on dist-test-slave-tc2s"
server_key: "fa6abbed4b7397b9b72b190fd6be21a0"
server_key_iv: "f5d3ccb7e95ba0bc1a2f366817210824"
server_key_version: "encryptionkey@0"
I20260812 06:58:46.702261 4047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:46.722241 4047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:46.722971 4047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:46.723199 4047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:46.739851 4047 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:33383
I20260812 06:58:46.739883 4165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:33383 every 8 connection(s)
I20260812 06:58:46.741092 4047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:58:46.743122 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 4047
I20260812 06:58:46.743314 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:58:46.743928 18714 external_mini_cluster.cc:1428] Setting key d04091c76159bd939d013325fc940b8a
I20260812 06:58:46.744875 4168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:46.758971 4172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:46.745865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49116 (local address 127.18.70.190:33383)
0812 06:58:46.746954 (+ 1089us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:46.746969 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:46.747018 (+ 49us) server_negotiation.cc:407] Connection header received
0812 06:58:46.749432 (+ 2414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:46.749461 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:46.750060 (+ 599us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:46.750472 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:46.750999 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:46.752952 (+ 1953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:46.754188 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:46.755179 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:46.755367 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:46.756339 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:46.756350 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:46.756371 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:46.757078 (+ 707us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:46.757187 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:46.757215 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:46.757329 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:46.757446 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 06:58:46.757741 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":325,"threads_started":1}
I20260812 06:58:46.759318 4168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42: Bootstrap starting.
I20260812 06:58:46.762758 4168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:46.763706 4168 log.cc:824] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:46.766345 4168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42: No bootstrap required, opened a new log
I20260812 06:58:46.773427 4168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72594832c7dc44bfb833ffa205fbbf42" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33383 } }
I20260812 06:58:46.773746 4168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:46.773840 4168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72594832c7dc44bfb833ffa205fbbf42, State: Initialized, Role: FOLLOWER
I20260812 06:58:46.774391 4168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72594832c7dc44bfb833ffa205fbbf42" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33383 } }
I20260812 06:58:46.774609 4168 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:58:46.774734 4168 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:58:46.774881 4168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:46.776877 4168 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72594832c7dc44bfb833ffa205fbbf42" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33383 } }
I20260812 06:58:46.777338 4168 leader_election.cc:302] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72594832c7dc44bfb833ffa205fbbf42; no voters:
I20260812 06:58:46.777932 4168 leader_election.cc:288] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:58:46.778014 4175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:46.778648 4175 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [term 1 LEADER]: Becoming Leader. State: Replica: 72594832c7dc44bfb833ffa205fbbf42, State: Running, Role: LEADER
I20260812 06:58:46.779160 4175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72594832c7dc44bfb833ffa205fbbf42" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33383 } }
I20260812 06:58:46.779904 4168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:58:46.782059 4176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72594832c7dc44bfb833ffa205fbbf42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72594832c7dc44bfb833ffa205fbbf42" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33383 } } }
I20260812 06:58:46.782066 4178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72594832c7dc44bfb833ffa205fbbf42. Latest consensus state: current_term: 1 leader_uuid: "72594832c7dc44bfb833ffa205fbbf42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72594832c7dc44bfb833ffa205fbbf42" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 33383 } } }
I20260812 06:58:46.782537 4178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:46.782541 4176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42 [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:46.783882 4188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:58:46.789011 4188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:58:46.796800 4188 catalog_manager.cc:1347] Generated new cluster ID: feba8030e784405e976ab54105d934b3
I20260812 06:58:46.796904 4188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:58:46.805799 4188 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:58:46.807550 4188 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:58:46.820109 4188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72594832c7dc44bfb833ffa205fbbf42: Generated new TSK 0
I20260812 06:58:46.820869 4188 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:58:46.831681 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33383
--builtin_ntp_servers=127.18.70.148:46063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 06:58:47.159505 4208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:47.159762 4208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:47.159883 4208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:47.166926 4208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:47.167017 4208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:47.167161 4208 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:58:47.175897 4208 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:47.177084 4208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:47.178913 4208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:47.191462 4219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:47.191496 4220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:47.191759 4222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:47.192462 4208 server_base.cc:1034] running on GCE node
I20260812 06:58:47.192996 4208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:47.193818 4208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:47.195045 4208 hybrid_clock.cc:648] HybridClock initialized: now 1786517927194993 us; error 53 us; skew 500 ppm
I20260812 06:58:47.195355 4208 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:58:47.200079 4208 webserver.cc:460] Webserver started at http://127.18.70.129:36891/ using document root <none> and password file <none>
I20260812 06:58:47.200760 4208 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:47.200860 4208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:47.201160 4208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:47.203929 4208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "1be850f978e642aaa845bb60493d7708"
format_stamp: "Formatted at 2026-08-12 06:58:47 on dist-test-slave-tc2s"
server_key: "bb19bcaad982991ef89ecf7f9612b936"
server_key_iv: "5c32ee28c6fbc583fab952d6387559f0"
server_key_version: "encryptionkey@0"
I20260812 06:58:47.204715 4208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "1be850f978e642aaa845bb60493d7708"
format_stamp: "Formatted at 2026-08-12 06:58:47 on dist-test-slave-tc2s"
server_key: "bb19bcaad982991ef89ecf7f9612b936"
server_key_iv: "5c32ee28c6fbc583fab952d6387559f0"
server_key_version: "encryptionkey@0"
I20260812 06:58:47.209535 4208 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.005s
I20260812 06:58:47.212720 4230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:47.213878 4208 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:58:47.214072 4208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "1be850f978e642aaa845bb60493d7708"
format_stamp: "Formatted at 2026-08-12 06:58:47 on dist-test-slave-tc2s"
server_key: "bb19bcaad982991ef89ecf7f9612b936"
server_key_iv: "5c32ee28c6fbc583fab952d6387559f0"
server_key_version: "encryptionkey@0"
I20260812 06:58:47.214262 4208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:47.235680 4208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:47.236449 4208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:47.236721 4208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:47.237596 4208 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:47.238991 4208 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:47.239085 4208 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:47.239190 4208 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:47.239260 4208 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:47.269160 4208 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:42555
I20260812 06:58:47.269224 4421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:42555 every 8 connection(s)
I20260812 06:58:47.270445 4208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:58:47.277022 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 4208
I20260812 06:58:47.277210 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:58:47.277930 18714 external_mini_cluster.cc:1428] Setting key 91339680f3a8b334d2b4e555bc38931c
I20260812 06:58:47.280906 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33383
--builtin_ntp_servers=127.18.70.148:46063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 06:58:47.282774 4432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:47.272799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:49565 (local address 127.18.70.190:33383)
0812 06:58:47.273259 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:47.273266 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:47.274378 (+ 1112us) server_negotiation.cc:407] Connection header received
0812 06:58:47.276066 (+ 1688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:47.276070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:47.276138 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:47.276231 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:47.277246 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:47.278101 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:47.280042 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:47.280474 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:47.280599 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:47.282070 (+ 1471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:47.282075 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:47.282078 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:47.282095 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:47.282142 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:47.282153 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:47.282221 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:47.282444 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 06:58:47.282526 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":213,"threads_started":1}
I20260812 06:58:47.284049 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:47.273352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:33383 (local address 127.18.70.129:49565)
0812 06:58:47.274232 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:47.274275 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:47.275852 (+ 1577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:47.276395 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:47.276402 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:47.276489 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:47.277063 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:47.277079 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:47.278259 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:47.278265 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:47.279896 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:47.279913 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:47.280700 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:47.280708 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:47.281015 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:47.281712 (+ 697us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:58:47.281715 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:47.281765 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:58:47.281866 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:47.282242 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:47.282251 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:47.282258 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:58:47.282443 (+ 185us) client_negotiation.cc:240] Negotiation successful
0812 06:58:47.282836 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":253,"threads_started":1}
I20260812 06:58:47.285524 4423 heartbeater.cc:347] Connected to a master server at 127.18.70.190:33383
I20260812 06:58:47.285790 4423 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:47.286509 4423 heartbeater.cc:511] Master 127.18.70.190:33383 requested a full tablet report, sending...
I20260812 06:58:47.288532 4104 ts_manager.cc:194] Registered new tserver with Master: 1be850f978e642aaa845bb60493d7708 (127.18.70.129:42555)
I20260812 06:58:47.290400 4104 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.129:49565
W20260812 06:58:47.603746 4437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:47.604044 4437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:47.604168 4437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:47.611284 4437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:47.611372 4437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:47.611517 4437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:58:47.620174 4437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:47.621322 4437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:47.623008 4437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:47.635001 4443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:47.634934 4452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:47.634934 4444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:47.635764 4437 server_base.cc:1034] running on GCE node
I20260812 06:58:47.636300 4437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:47.637141 4437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:47.638332 4437 hybrid_clock.cc:648] HybridClock initialized: now 1786517927638292 us; error 31 us; skew 500 ppm
I20260812 06:58:47.638630 4437 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:58:47.640663 4437 webserver.cc:460] Webserver started at http://127.18.70.130:44251/ using document root <none> and password file <none>
I20260812 06:58:47.641279 4437 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:47.641386 4437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:47.641682 4437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:47.644452 4437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "d463c6d3559c40ddbadd942071d15bc3"
format_stamp: "Formatted at 2026-08-12 06:58:47 on dist-test-slave-tc2s"
server_key: "bd2d71387b7c85b94239f0cea4cb666f"
server_key_iv: "e68cdc8f72f6544dbce07d1785fe2bb2"
server_key_version: "encryptionkey@0"
I20260812 06:58:47.645184 4437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "d463c6d3559c40ddbadd942071d15bc3"
format_stamp: "Formatted at 2026-08-12 06:58:47 on dist-test-slave-tc2s"
server_key: "bd2d71387b7c85b94239f0cea4cb666f"
server_key_iv: "e68cdc8f72f6544dbce07d1785fe2bb2"
server_key_version: "encryptionkey@0"
I20260812 06:58:47.649865 4437 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260812 06:58:47.653116 4461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:47.654340 4437 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:58:47.654493 4437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "d463c6d3559c40ddbadd942071d15bc3"
format_stamp: "Formatted at 2026-08-12 06:58:47 on dist-test-slave-tc2s"
server_key: "bd2d71387b7c85b94239f0cea4cb666f"
server_key_iv: "e68cdc8f72f6544dbce07d1785fe2bb2"
server_key_version: "encryptionkey@0"
I20260812 06:58:47.654678 4437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:47.681681 4437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:47.682485 4437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:47.682749 4437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:47.683641 4437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:47.685045 4437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:47.685144 4437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:47.685225 4437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:47.685282 4437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:47.714612 4437 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:44451
I20260812 06:58:47.714646 4664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:44451 every 8 connection(s)
I20260812 06:58:47.715785 4437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:58:47.724895 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 4437
I20260812 06:58:47.725056 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:58:47.725456 18714 external_mini_cluster.cc:1428] Setting key 97075b125156af936813dae48ee14c45
I20260812 06:58:47.727398 4432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:47.718107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:40941 (local address 127.18.70.190:33383)
0812 06:58:47.718262 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:47.718266 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:47.719654 (+ 1388us) server_negotiation.cc:407] Connection header received
0812 06:58:47.721346 (+ 1692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:47.721352 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:47.721430 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:47.721517 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:47.722561 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:47.723272 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:47.724744 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:47.725199 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:47.725316 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:47.726567 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:47.726572 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:47.726576 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:47.726599 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:47.726632 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:47.726644 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:47.726716 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:47.727000 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 06:58:47.727093 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:58:47.728202 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33383
--builtin_ntp_servers=127.18.70.148:46063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 06:58:47.728281 4670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:47.718680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:33383 (local address 127.18.70.130:40941)
0812 06:58:47.719517 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:47.719551 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:47.721099 (+ 1548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:47.721738 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:47.721746 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:47.721826 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:47.722388 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:47.722405 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:47.723419 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:47.723423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:47.724602 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:47.724615 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:47.725414 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:47.725422 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:47.725665 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:47.726280 (+ 615us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:58:47.726282 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:47.726322 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:58:47.726401 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:47.726737 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:47.726748 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:47.726755 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:58:47.726946 (+ 191us) client_negotiation.cc:240] Negotiation successful
0812 06:58:47.727295 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":254,"threads_started":1}
I20260812 06:58:47.729435 4667 heartbeater.cc:347] Connected to a master server at 127.18.70.190:33383
I20260812 06:58:47.729687 4667 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:47.730409 4667 heartbeater.cc:511] Master 127.18.70.190:33383 requested a full tablet report, sending...
I20260812 06:58:47.731693 4104 ts_manager.cc:194] Registered new tserver with Master: d463c6d3559c40ddbadd942071d15bc3 (127.18.70.130:44451)
I20260812 06:58:47.732447 4104 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.130:40941
W20260812 06:58:48.046156 4671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:48.046406 4671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:48.046521 4671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:48.053485 4671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:48.053573 4671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:48.053721 4671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:58:48.062569 4671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:33383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:48.063757 4671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:48.065461 4671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:48.077682 4683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:48.077706 4680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:48.078229 4679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:48.078447 4671 server_base.cc:1034] running on GCE node
I20260812 06:58:48.078996 4671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:48.079881 4671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:48.081069 4671 hybrid_clock.cc:648] HybridClock initialized: now 1786517928081011 us; error 50 us; skew 500 ppm
I20260812 06:58:48.081368 4671 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:58:48.083407 4671 webserver.cc:460] Webserver started at http://127.18.70.131:34485/ using document root <none> and password file <none>
I20260812 06:58:48.084056 4671 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:48.084157 4671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:48.084468 4671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:48.087191 4671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "da9fb52c05824e28b6b052f829cf2bf4"
format_stamp: "Formatted at 2026-08-12 06:58:48 on dist-test-slave-tc2s"
server_key: "ba9af039148eab8a5a736e81b74fb889"
server_key_iv: "ce31ded72e45668329c65f36b79864a6"
server_key_version: "encryptionkey@0"
I20260812 06:58:48.087922 4671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "da9fb52c05824e28b6b052f829cf2bf4"
format_stamp: "Formatted at 2026-08-12 06:58:48 on dist-test-slave-tc2s"
server_key: "ba9af039148eab8a5a736e81b74fb889"
server_key_iv: "ce31ded72e45668329c65f36b79864a6"
server_key_version: "encryptionkey@0"
I20260812 06:58:48.092835 4671 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 06:58:48.096098 4696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:48.097313 4671 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 06:58:48.097474 4671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "da9fb52c05824e28b6b052f829cf2bf4"
format_stamp: "Formatted at 2026-08-12 06:58:48 on dist-test-slave-tc2s"
server_key: "ba9af039148eab8a5a736e81b74fb889"
server_key_iv: "ce31ded72e45668329c65f36b79864a6"
server_key_version: "encryptionkey@0"
I20260812 06:58:48.097658 4671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:48.113672 4671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:48.114467 4671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:48.114732 4671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:48.115586 4671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:48.116884 4671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:48.116978 4671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:48.117089 4671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:48.117158 4671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:48.147099 4671 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:35881
I20260812 06:58:48.147157 4902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:35881 every 8 connection(s)
I20260812 06:58:48.148285 4671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:58:48.151042 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 4671
I20260812 06:58:48.151216 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:58:48.151825 18714 external_mini_cluster.cc:1428] Setting key 90b0da133ea481a0705944ab9d6592a3
I20260812 06:58:48.160430 4432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:48.150688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:50155 (local address 127.18.70.190:33383)
0812 06:58:48.150907 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:48.150914 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:48.152425 (+ 1511us) server_negotiation.cc:407] Connection header received
0812 06:58:48.154581 (+ 2156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:48.154586 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:48.154670 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:48.154774 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:48.155748 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:48.156460 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:48.158008 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:48.158420 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:48.158542 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:48.159779 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:48.159785 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:48.159788 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:48.159805 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:48.159836 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:48.159848 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:48.159927 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:48.160097 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 06:58:48.160171 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 06:58:48.161312 4906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:48.151198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:33383 (local address 127.18.70.131:50155)
0812 06:58:48.152266 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:48.152314 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:48.154341 (+ 2027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:48.155018 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:48.155025 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:48.155103 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:48.155622 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:48.155638 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:48.156572 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:48.156575 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:48.157822 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:48.157839 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:48.158634 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:48.158640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:48.158837 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:48.159496 (+ 659us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:58:48.159498 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:48.159542 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:58:48.159612 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:48.159932 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:48.159938 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:48.159943 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:58:48.160084 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 06:58:48.160364 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":298,"threads_started":1}
I20260812 06:58:48.162541 4904 heartbeater.cc:347] Connected to a master server at 127.18.70.190:33383
I20260812 06:58:48.162801 4904 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:48.163511 4904 heartbeater.cc:511] Master 127.18.70.190:33383 requested a full tablet report, sending...
I20260812 06:58:48.164733 4104 ts_manager.cc:194] Registered new tserver with Master: da9fb52c05824e28b6b052f829cf2bf4 (127.18.70.131:35881)
I20260812 06:58:48.165602 4104 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.131:50155
I20260812 06:58:48.166949 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:58:48.175297 4432 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:48.173780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49122 (local address 127.18.70.190:33383)
0812 06:58:48.174002 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:48.174006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:48.174478 (+ 472us) server_negotiation.cc:407] Connection header received
0812 06:58:48.174607 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:48.174611 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:48.174669 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:48.174746 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:48.175070 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49122: BlockingRecv error: recv got EOF from 127.0.0.1:49122 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 06:58:48.176673 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 4208
I20260812 06:58:48.184252 4921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:48.177586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55994 (local address 127.18.70.129:42555)
0812 06:58:48.178104 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:48.178110 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:48.178135 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:58:48.178189 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:48.178195 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:48.178378 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:48.178490 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:48.178819 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:48.179769 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:48.181084 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:48.181621 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:48.181740 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:48.182795 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:48.182805 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:48.182820 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:48.183461 (+ 641us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:48.183505 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:48.183525 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:48.183608 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:48.183760 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 06:58:48.183918 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":238,"threads_started":1}
I20260812 06:58:48.185357 4414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:48.265167 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 4208
I20260812 06:58:48.286635 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 4437
I20260812 06:58:48.293802 4924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:48.287514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51064 (local address 127.18.70.130:44451)
0812 06:58:48.288017 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:48.288025 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:48.288054 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:58:48.288119 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:48.288126 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:48.288346 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:48.288474 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:48.288858 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:48.289828 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:48.291045 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:48.291573 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:48.291668 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:48.292536 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:48.292544 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:48.292556 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:48.293135 (+ 579us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:48.293182 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:48.293202 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:48.293288 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:48.293394 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 06:58:48.293506 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":242,"threads_started":1}
I20260812 06:58:48.295122 4658 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:48.374042 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 4437
I20260812 06:58:48.399247 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 4671
I20260812 06:58:48.407203 4926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:48.400184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58868 (local address 127.18.70.131:35881)
0812 06:58:48.400819 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:48.400826 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:48.400857 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:58:48.400918 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:48.400924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:48.401190 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:48.401323 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:48.401723 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:48.402856 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:48.404134 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:48.404685 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:48.404780 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:48.405772 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:48.405781 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:48.405794 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:48.406450 (+ 656us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:48.406498 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:48.406519 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:48.406602 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:48.406756 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 06:58:48.406882 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":332,"threads_started":1}
I20260812 06:58:48.408387 4896 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:48.489195 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 4671
I20260812 06:58:48.512310 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 4047
I20260812 06:58:48.513518 4158 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:48.625996 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 4047
2026-08-12T06:58:48Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2373 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T06:58:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:58:48Z Disabled control of system clock
I20260812 06:58:48.711104 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36711
--webserver_interface=127.18.70.190
--webserver_port=0
--builtin_ntp_servers=127.18.70.148:33289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:36711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 06:58:49.033205 4934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:49.033465 4934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:49.033550 4934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:49.040601 4934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:58:49.040697 4934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:49.040741 4934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:49.040797 4934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:58:49.040841 4934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:58:49.049722 4934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:33289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:36711
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:49.050987 4934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:49.052747 4934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:49.063870 4941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:49.063956 4943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:49.063915 4948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:49.064857 4934 server_base.cc:1034] running on GCE node
I20260812 06:58:49.065619 4934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:49.066967 4934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:49.068166 4934 hybrid_clock.cc:648] HybridClock initialized: now 1786517929068115 us; error 43 us; skew 500 ppm
I20260812 06:58:49.068491 4934 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:58:49.070631 4934 webserver.cc:460] Webserver started at http://127.18.70.190:40667/ using document root <none> and password file <none>
I20260812 06:58:49.071285 4934 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:49.071386 4934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:49.071698 4934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:49.075986 4934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "82cad5c0bc134df68702a82d566b1d4d"
format_stamp: "Formatted at 2026-08-12 06:58:49 on dist-test-slave-tc2s"
server_key: "79978728466137eba082709829d75207"
server_key_iv: "f5e7211704dd70d7fb94982b8962dace"
server_key_version: "encryptionkey@0"
I20260812 06:58:49.076757 4934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "82cad5c0bc134df68702a82d566b1d4d"
format_stamp: "Formatted at 2026-08-12 06:58:49 on dist-test-slave-tc2s"
server_key: "79978728466137eba082709829d75207"
server_key_iv: "f5e7211704dd70d7fb94982b8962dace"
server_key_version: "encryptionkey@0"
I20260812 06:58:49.081744 4934 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 06:58:49.084981 4971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:49.086212 4934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:58:49.086369 4934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "82cad5c0bc134df68702a82d566b1d4d"
format_stamp: "Formatted at 2026-08-12 06:58:49 on dist-test-slave-tc2s"
server_key: "79978728466137eba082709829d75207"
server_key_iv: "f5e7211704dd70d7fb94982b8962dace"
server_key_version: "encryptionkey@0"
I20260812 06:58:49.086562 4934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:49.092022 4934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:49.092727 4934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:49.093009 4934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:49.109742 4934 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:36711
I20260812 06:58:49.109776 5046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:36711 every 8 connection(s)
I20260812 06:58:49.111044 4934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:58:49.114645 5047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:49.120569 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 4934
I20260812 06:58:49.120735 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:58:49.121356 18714 external_mini_cluster.cc:1428] Setting key 53bdad026c4b1dc18aa85ab203fd782d
I20260812 06:58:49.125065 5047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d: Bootstrap starting.
I20260812 06:58:49.128518 5047 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:49.129175 5054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:49.123318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51016 (local address 127.18.70.190:36711)
0812 06:58:49.124249 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:49.124259 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:49.124298 (+ 39us) server_negotiation.cc:407] Connection header received
0812 06:58:49.125938 (+ 1640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:49.125961 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:49.126325 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:49.126636 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:49.127680 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:49.127685 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:49.127697 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:49.127711 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:49.127763 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:49.127778 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:49.127926 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:49.128056 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 06:58:49.128301 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":309,"threads_started":1}
I20260812 06:58:49.129576 5047 log.cc:824] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:49.132185 5047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d: No bootstrap required, opened a new log
I20260812 06:58:49.140091 5047 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cad5c0bc134df68702a82d566b1d4d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36711 } }
I20260812 06:58:49.140511 5047 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:49.140605 5047 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82cad5c0bc134df68702a82d566b1d4d, State: Initialized, Role: FOLLOWER
I20260812 06:58:49.141146 5047 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cad5c0bc134df68702a82d566b1d4d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36711 } }
I20260812 06:58:49.141363 5047 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:58:49.141492 5047 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:58:49.141651 5047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:49.143757 5047 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cad5c0bc134df68702a82d566b1d4d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36711 } }
I20260812 06:58:49.144233 5047 leader_election.cc:302] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82cad5c0bc134df68702a82d566b1d4d; no voters:
I20260812 06:58:49.144807 5047 leader_election.cc:288] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:58:49.144929 5061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:49.145612 5061 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [term 1 LEADER]: Becoming Leader. State: Replica: 82cad5c0bc134df68702a82d566b1d4d, State: Running, Role: LEADER
I20260812 06:58:49.146164 5061 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cad5c0bc134df68702a82d566b1d4d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36711 } }
I20260812 06:58:49.146886 5047 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:58:49.149365 5067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82cad5c0bc134df68702a82d566b1d4d. Latest consensus state: current_term: 1 leader_uuid: "82cad5c0bc134df68702a82d566b1d4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cad5c0bc134df68702a82d566b1d4d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36711 } } }
I20260812 06:58:49.149082 5065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82cad5c0bc134df68702a82d566b1d4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82cad5c0bc134df68702a82d566b1d4d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36711 } } }
I20260812 06:58:49.150092 5067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:49.150297 5065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:49.154850 5077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:58:49.159188 5077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:58:49.167059 5077 catalog_manager.cc:1347] Generated new cluster ID: 3f9772a95f554c639bb7036ae36c7db7
I20260812 06:58:49.167173 5077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:58:49.190594 5077 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:58:49.191143 5077 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:58:49.201462 5077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82cad5c0bc134df68702a82d566b1d4d: Generated new TSK 0
I20260812 06:58:49.202471 5077 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:58:49.217933 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36711
--builtin_ntp_servers=127.18.70.148:33289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 06:58:49.544303 5091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:49.544585 5091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:49.544718 5091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:49.551790 5091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:49.551889 5091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:49.552058 5091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:58:49.560877 5091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:33289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36711
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:49.562151 5091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:49.563881 5091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:49.576079 5099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:49.576119 5100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:49.576148 5104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:49.577091 5091 server_base.cc:1034] running on GCE node
I20260812 06:58:49.577672 5091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:49.578557 5091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:49.579741 5091 hybrid_clock.cc:648] HybridClock initialized: now 1786517929579679 us; error 57 us; skew 500 ppm
I20260812 06:58:49.580015 5091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:58:49.582085 5091 webserver.cc:460] Webserver started at http://127.18.70.129:46645/ using document root <none> and password file <none>
I20260812 06:58:49.582737 5091 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:49.582830 5091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:49.583130 5091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:49.585965 5091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "27c73a1e41fd440e8e381b4ce5191f49"
format_stamp: "Formatted at 2026-08-12 06:58:49 on dist-test-slave-tc2s"
server_key: "4cea59beb93325e7ba36f06905890124"
server_key_iv: "ad05ad97d20de8866c939c3b4d1354b0"
server_key_version: "encryptionkey@0"
I20260812 06:58:49.586735 5091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "27c73a1e41fd440e8e381b4ce5191f49"
format_stamp: "Formatted at 2026-08-12 06:58:49 on dist-test-slave-tc2s"
server_key: "4cea59beb93325e7ba36f06905890124"
server_key_iv: "ad05ad97d20de8866c939c3b4d1354b0"
server_key_version: "encryptionkey@0"
I20260812 06:58:49.591595 5091 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 06:58:49.594805 5114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:49.596036 5091 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:58:49.596166 5091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "27c73a1e41fd440e8e381b4ce5191f49"
format_stamp: "Formatted at 2026-08-12 06:58:49 on dist-test-slave-tc2s"
server_key: "4cea59beb93325e7ba36f06905890124"
server_key_iv: "ad05ad97d20de8866c939c3b4d1354b0"
server_key_version: "encryptionkey@0"
I20260812 06:58:49.596339 5091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:49.601528 5091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:49.602269 5091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:49.602481 5091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:49.603304 5091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:49.604568 5091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:49.604655 5091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:49.604735 5091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:49.604789 5091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:49.633814 5091 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:43231
I20260812 06:58:49.633885 5326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:43231 every 8 connection(s)
I20260812 06:58:49.635088 5091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:58:49.642578 5330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:49.637485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:44525 (local address 127.18.70.190:36711)
0812 06:58:49.637945 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:49.637950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:49.639069 (+ 1119us) server_negotiation.cc:407] Connection header received
0812 06:58:49.640684 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:49.640688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:49.640741 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:49.640831 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:49.641995 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:49.642000 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:49.642003 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:49.642020 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:49.642062 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:49.642073 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:49.642170 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:49.642302 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 06:58:49.642352 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":217,"threads_started":1}
I20260812 06:58:49.643419 5331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:49.638057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36711 (local address 127.18.70.129:44525)
0812 06:58:49.638915 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:49.638958 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:49.640462 (+ 1504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:49.641003 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:49.641011 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:49.641091 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:49.641706 (+ 615us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:58:49.641709 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:49.641744 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:58:49.641826 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:49.642150 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:49.642156 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:49.642161 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:58:49.642377 (+ 216us) client_negotiation.cc:240] Negotiation successful
0812 06:58:49.642555 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":262,"threads_started":1}
I20260812 06:58:49.643586 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 5091
I20260812 06:58:49.643769 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:58:49.644523 18714 external_mini_cluster.cc:1428] Setting key 66c0739493190fcd901cda432fa32b0e
I20260812 06:58:49.644873 5327 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36711
I20260812 06:58:49.645155 5327 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:49.645839 5327 heartbeater.cc:511] Master 127.18.70.190:36711 requested a full tablet report, sending...
I20260812 06:58:49.647321 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36711
--builtin_ntp_servers=127.18.70.148:33289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 06:58:49.647985 4997 ts_manager.cc:194] Registered new tserver with Master: 27c73a1e41fd440e8e381b4ce5191f49 (127.18.70.129:43231)
W20260812 06:58:49.965939 5332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:49.966194 5332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:49.966288 5332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:49.973176 5332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:49.973263 5332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:49.973385 5332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:58:49.982158 5332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:33289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36711
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:49.983345 5332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:49.985059 5332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:49.997406 5342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:49.997542 5346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:49.997483 5348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:49.998520 5332 server_base.cc:1034] running on GCE node
I20260812 06:58:49.999104 5332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:49.999961 5332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:50.001156 5332 hybrid_clock.cc:648] HybridClock initialized: now 1786517930001105 us; error 43 us; skew 500 ppm
I20260812 06:58:50.001457 5332 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:58:50.003509 5332 webserver.cc:460] Webserver started at http://127.18.70.130:41135/ using document root <none> and password file <none>
I20260812 06:58:50.004133 5332 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:50.004230 5332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:50.004539 5332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:50.007236 5332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "2e34214338c745a197003eada06fc154"
format_stamp: "Formatted at 2026-08-12 06:58:50 on dist-test-slave-tc2s"
server_key: "450f125a4e56d9bb7997883a64fc73c5"
server_key_iv: "e23907959960da252f84dd0dd6026271"
server_key_version: "encryptionkey@0"
I20260812 06:58:50.007977 5332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "2e34214338c745a197003eada06fc154"
format_stamp: "Formatted at 2026-08-12 06:58:50 on dist-test-slave-tc2s"
server_key: "450f125a4e56d9bb7997883a64fc73c5"
server_key_iv: "e23907959960da252f84dd0dd6026271"
server_key_version: "encryptionkey@0"
I20260812 06:58:50.012636 5332 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260812 06:58:50.015848 5357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:50.017055 5332 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 06:58:50.017198 5332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "2e34214338c745a197003eada06fc154"
format_stamp: "Formatted at 2026-08-12 06:58:50 on dist-test-slave-tc2s"
server_key: "450f125a4e56d9bb7997883a64fc73c5"
server_key_iv: "e23907959960da252f84dd0dd6026271"
server_key_version: "encryptionkey@0"
I20260812 06:58:50.017402 5332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:50.023008 5332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:50.023737 5332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:50.023976 5332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:50.024842 5332 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:50.026190 5332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:50.026290 5332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:50.026398 5332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:50.026476 5332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:50.055919 5332 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:33779
I20260812 06:58:50.055971 5569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:33779 every 8 connection(s)
I20260812 06:58:50.057173 5332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:58:50.059634 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 5332
I20260812 06:58:50.059782 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:58:50.060333 18714 external_mini_cluster.cc:1428] Setting key 6f253870647cf39153bda2104ed659ef
I20260812 06:58:50.062848 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36711
--builtin_ntp_servers=127.18.70.148:33289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 06:58:50.065023 5330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:50.059632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:33641 (local address 127.18.70.190:36711)
0812 06:58:50.059859 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:50.059865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:50.061283 (+ 1418us) server_negotiation.cc:407] Connection header received
0812 06:58:50.063013 (+ 1730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:50.063018 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:50.063082 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:50.063181 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:50.064363 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:50.064369 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:50.064373 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:50.064391 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:50.064430 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:50.064444 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:50.064566 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:50.064684 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 06:58:50.064744 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 06:58:50.065771 5572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:50.060126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36711 (local address 127.18.70.130:33641)
0812 06:58:50.061130 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:50.061182 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:50.062747 (+ 1565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:50.063360 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:50.063366 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:50.063455 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:50.064084 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:58:50.064086 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:50.064123 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:58:50.064196 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:50.064527 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:50.064533 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:50.064539 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:58:50.064729 (+ 190us) client_negotiation.cc:240] Negotiation successful
0812 06:58:50.064904 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":328,"threads_started":1}
I20260812 06:58:50.067013 5570 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36711
I20260812 06:58:50.067288 5570 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:50.067931 5570 heartbeater.cc:511] Master 127.18.70.190:36711 requested a full tablet report, sending...
I20260812 06:58:50.069305 4997 ts_manager.cc:194] Registered new tserver with Master: 2e34214338c745a197003eada06fc154 (127.18.70.130:33779)
W20260812 06:58:50.386523 5574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:50.386813 5574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:50.386950 5574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:50.394131 5574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:50.394217 5574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:50.394366 5574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:58:50.403311 5574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:33289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36711
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:50.404574 5574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:50.406337 5574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:50.418612 5582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:50.418656 5584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:50.418695 5587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:50.419719 5574 server_base.cc:1034] running on GCE node
I20260812 06:58:50.420238 5574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:50.421118 5574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:50.422300 5574 hybrid_clock.cc:648] HybridClock initialized: now 1786517930422263 us; error 33 us; skew 500 ppm
I20260812 06:58:50.422595 5574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 06:58:50.424607 5574 webserver.cc:460] Webserver started at http://127.18.70.131:36457/ using document root <none> and password file <none>
I20260812 06:58:50.425241 5574 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:50.425334 5574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:50.425668 5574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:50.428452 5574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "09d5612ddaac4c369ef36b598ecc0980"
format_stamp: "Formatted at 2026-08-12 06:58:50 on dist-test-slave-tc2s"
server_key: "a3846ebee03883849faf1a790a20ee5f"
server_key_iv: "7aec07bc8d3293111fef41230d54f461"
server_key_version: "encryptionkey@0"
I20260812 06:58:50.429196 5574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "09d5612ddaac4c369ef36b598ecc0980"
format_stamp: "Formatted at 2026-08-12 06:58:50 on dist-test-slave-tc2s"
server_key: "a3846ebee03883849faf1a790a20ee5f"
server_key_iv: "7aec07bc8d3293111fef41230d54f461"
server_key_version: "encryptionkey@0"
I20260812 06:58:50.433943 5574 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260812 06:58:50.437093 5604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:50.438315 5574 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260812 06:58:50.438469 5574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "09d5612ddaac4c369ef36b598ecc0980"
format_stamp: "Formatted at 2026-08-12 06:58:50 on dist-test-slave-tc2s"
server_key: "a3846ebee03883849faf1a790a20ee5f"
server_key_iv: "7aec07bc8d3293111fef41230d54f461"
server_key_version: "encryptionkey@0"
I20260812 06:58:50.438671 5574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:50.443862 5574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:50.444576 5574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:50.444808 5574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:50.445645 5574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:50.446979 5574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:50.447072 5574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:50.447175 5574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:50.447259 5574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:50.475489 5574 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:40835
I20260812 06:58:50.475535 5805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:40835 every 8 connection(s)
I20260812 06:58:50.476743 5574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:58:50.484334 5330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:50.479170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:49801 (local address 127.18.70.190:36711)
0812 06:58:50.479326 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:50.479330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:50.480642 (+ 1312us) server_negotiation.cc:407] Connection header received
0812 06:58:50.482304 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:50.482311 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:50.482380 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:50.482471 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:50.483630 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:50.483636 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:50.483639 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:50.483655 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:50.483687 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:50.483697 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:50.483798 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:50.483985 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 06:58:50.484055 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 06:58:50.485123 5810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:50.479626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36711 (local address 127.18.70.131:49801)
0812 06:58:50.480484 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:50.480524 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:50.482044 (+ 1520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:50.482691 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:50.482698 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:50.482780 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:50.483345 (+ 565us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:58:50.483348 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:50.483385 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:58:50.483464 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:50.483779 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:50.483788 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:50.483796 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 06:58:50.484049 (+ 253us) client_negotiation.cc:240] Negotiation successful
0812 06:58:50.484272 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":261,"threads_started":1}
I20260812 06:58:50.486279 5806 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36711
I20260812 06:58:50.486568 5806 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:50.486809 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 5574
I20260812 06:58:50.486955 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:58:50.487156 5806 heartbeater.cc:511] Master 127.18.70.190:36711 requested a full tablet report, sending...
I20260812 06:58:50.487411 18714 external_mini_cluster.cc:1428] Setting key 89ae4494ca12a9aeb5853053200ac475
I20260812 06:58:50.488463 4997 ts_manager.cc:194] Registered new tserver with Master: 09d5612ddaac4c369ef36b598ecc0980 (127.18.70.131:40835)
I20260812 06:58:50.490196 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:58:50.495820 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:58:50.494470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51026 (local address 127.18.70.190:36711)
0812 06:58:50.494614 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:50.494619 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:50.495092 (+ 473us) server_negotiation.cc:407] Connection header received
0812 06:58:50.495202 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:50.495206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:50.495254 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:50.495328 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:50.495594 (+ 266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51026: BlockingRecv error: recv got EOF from 127.0.0.1:51026 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 06:58:50.496775 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 5091
I20260812 06:58:50.499820 5825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:50.497604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58646 (local address 127.18.70.129:43231)
0812 06:58:50.498080 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:50.498086 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:50.498111 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:58:50.498167 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:50.498172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:50.498339 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:50.498459 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:50.499253 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:50.499260 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:50.499270 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:50.499283 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:50.499347 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:50.499373 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:50.499482 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:50.499526 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 06:58:50.499607 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":196,"threads_started":1}
I20260812 06:58:50.501088 5319 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:50.580904 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 5091
I20260812 06:58:50.606755 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 5332
I20260812 06:58:50.610157 5828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:50.607784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39070 (local address 127.18.70.130:33779)
0812 06:58:50.608261 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:50.608269 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:50.608294 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:58:50.608358 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:50.608365 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:50.608580 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:50.608703 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:50.609548 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:50.609554 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:50.609565 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:50.609577 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:50.609619 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:50.609633 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:50.609735 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:50.609782 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 06:58:50.609866 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":225,"threads_started":1}
I20260812 06:58:50.611363 5556 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:50.690510 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 5332
I20260812 06:58:50.716949 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 5574
I20260812 06:58:50.720700 5837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:50.718007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46614 (local address 127.18.70.131:40835)
0812 06:58:50.718674 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:50.718681 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:50.718712 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:58:50.718773 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:50.718780 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:50.719006 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:50.719131 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:50.720006 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:50.720012 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:50.720023 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:58:50.720039 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:50.720075 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:58:50.720088 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:50.720215 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:50.720265 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 06:58:50.720377 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":332,"threads_started":1}
I20260812 06:58:50.721873 5798 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:50.800652 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 5574
I20260812 06:58:50.820659 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 4934
I20260812 06:58:50.821846 5040 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:50.921483 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 4934
2026-08-12T06:58:50Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2293 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:58:51 dist-test-slave-tc2s krb5kdc[5844](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:58:51 dist-test-slave-tc2s krb5kdc[5844](info): set up 2 sockets
Aug 12 06:58:51 dist-test-slave-tc2s krb5kdc[5844](info): commencing operation
krb5kdc: starting...
W20260812 06:58:52.169983 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:58:52 dist-test-slave-tc2s krb5kdc[5844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:58:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:58:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:58:52.399556 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:34329
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:34329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:52.724189 5864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:52.724459 5864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:52.724556 5864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:52.731473 5864 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:58:52.731568 5864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:52.731623 5864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:52.731678 5864 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:58:52.731719 5864 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:58:52.740917 5864 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:34329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:34329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:52.742075 5864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:52.743249 5864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:52.754168 5884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:52.754204 5876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:52.754231 5882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:52.754904 5864 server_base.cc:1034] running on GCE node
I20260812 06:58:52.755580 5864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:52.756819 5864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:52.757979 5864 hybrid_clock.cc:648] HybridClock initialized: now 1786517932757938 us; error 30 us; skew 500 ppm
I20260812 06:58:52.758288 5864 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:52 dist-test-slave-tc2s krb5kdc[5844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517932, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:52.765093 5864 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:58:52.766573 5864 webserver.cc:460] Webserver started at http://127.18.70.190:40853/ using document root <none> and password file <none>
I20260812 06:58:52.767215 5864 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:52.767333 5864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:52.767632 5864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:52.770560 5864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "ce6ee180515a4e469b051f699cfa468f"
format_stamp: "Formatted at 2026-08-12 06:58:52 on dist-test-slave-tc2s"
server_key: "1d67f3cf233e7218e7b606843c14af38"
server_key_iv: "3a6e5487ebe36bb3a52ed7811be053de"
server_key_version: "encryptionkey@0"
I20260812 06:58:52.771279 5864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "ce6ee180515a4e469b051f699cfa468f"
format_stamp: "Formatted at 2026-08-12 06:58:52 on dist-test-slave-tc2s"
server_key: "1d67f3cf233e7218e7b606843c14af38"
server_key_iv: "3a6e5487ebe36bb3a52ed7811be053de"
server_key_version: "encryptionkey@0"
I20260812 06:58:52.776094 5864 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 06:58:52.779294 5899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:52.780493 5864 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 06:58:52.780653 5864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "ce6ee180515a4e469b051f699cfa468f"
format_stamp: "Formatted at 2026-08-12 06:58:52 on dist-test-slave-tc2s"
server_key: "1d67f3cf233e7218e7b606843c14af38"
server_key_iv: "3a6e5487ebe36bb3a52ed7811be053de"
server_key_version: "encryptionkey@0"
I20260812 06:58:52.780824 5864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:52.806429 5864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:52.809998 5864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:52.810261 5864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:52.827064 5864 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:34329
I20260812 06:58:52.827099 6000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:34329 every 8 connection(s)
I20260812 06:58:52.828343 5864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:58:52.830717 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 5864
I20260812 06:58:52.830941 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:58:52.831781 18714 external_mini_cluster.cc:1428] Setting key 374dd9e509145832cd9c2cae163e8512
I20260812 06:58:52.832381 6003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:52.845983 6003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f: Bootstrap starting.
Aug 12 06:58:52 dist-test-slave-tc2s krb5kdc[5844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:52.848937 6003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:52.849969 6003 log.cc:824] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:52.852581 6003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f: No bootstrap required, opened a new log
I20260812 06:58:52.853842 6009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:52.833768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42664 (local address 127.18.70.190:34329)
0812 06:58:52.834635 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:52.834646 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:52.834688 (+ 42us) server_negotiation.cc:407] Connection header received
0812 06:58:52.836808 (+ 2120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:52.836829 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:52.837169 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:52.837473 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:52.839249 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:52.840483 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:52.842149 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:52.842814 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:52.842951 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:52.847339 (+ 4388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:52.847347 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:52.847359 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:52.847397 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:52.850259 (+ 2862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:52.850867 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:52.850873 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:52.850878 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:52.851056 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:52.851404 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:52.851408 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:52.851410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:52.851881 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:52.852182 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:52.852574 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 06:58:52.852950 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":365,"threads_started":1}
I20260812 06:58:52.859925 6003 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce6ee180515a4e469b051f699cfa468f" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34329 } }
I20260812 06:58:52.860253 6003 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:52.860355 6003 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce6ee180515a4e469b051f699cfa468f, State: Initialized, Role: FOLLOWER
I20260812 06:58:52.860872 6003 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce6ee180515a4e469b051f699cfa468f" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34329 } }
I20260812 06:58:52.861079 6003 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:58:52.861198 6003 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:58:52.861348 6003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:52.863672 6003 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce6ee180515a4e469b051f699cfa468f" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34329 } }
I20260812 06:58:52.864109 6003 leader_election.cc:302] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce6ee180515a4e469b051f699cfa468f; no voters:
I20260812 06:58:52.864634 6003 leader_election.cc:288] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:58:52.864748 6012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:52.865360 6012 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [term 1 LEADER]: Becoming Leader. State: Replica: ce6ee180515a4e469b051f699cfa468f, State: Running, Role: LEADER
I20260812 06:58:52.865881 6012 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce6ee180515a4e469b051f699cfa468f" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34329 } }
I20260812 06:58:52.866612 6003 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:58:52.868436 6013 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce6ee180515a4e469b051f699cfa468f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce6ee180515a4e469b051f699cfa468f" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34329 } } }
I20260812 06:58:52.868788 6013 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:52.870950 6019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:58:52.870925 6015 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce6ee180515a4e469b051f699cfa468f. Latest consensus state: current_term: 1 leader_uuid: "ce6ee180515a4e469b051f699cfa468f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce6ee180515a4e469b051f699cfa468f" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34329 } } }
I20260812 06:58:52.871269 6015 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f [sys.catalog]: This master's current role is: LEADER
I20260812 06:58:52.875712 6019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:58:52.884443 6019 catalog_manager.cc:1347] Generated new cluster ID: 245f63bcc1eb455cbbc7aa78344d46f4
I20260812 06:58:52.884542 6019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:58:52.896708 6019 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:58:52.898384 6019 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:58:52.922079 6019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f: Generated new TSK 0
I20260812 06:58:52.923096 6019 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:58:52.979409 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34329
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:53.301802 6043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:53.302093 6043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:53.302229 6043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:53.309381 6043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:53.309499 6043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:53.309650 6043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:58:53.318922 6043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:53.320129 6043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:53.321372 6043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:53.333397 6050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:53.333441 6051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:53.333463 6055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:53.334394 6043 server_base.cc:1034] running on GCE node
I20260812 06:58:53.334937 6043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:53.335769 6043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:53.336957 6043 hybrid_clock.cc:648] HybridClock initialized: now 1786517933336906 us; error 45 us; skew 500 ppm
I20260812 06:58:53.337231 6043 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:53 dist-test-slave-tc2s krb5kdc[5844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517933, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:53.340142 6043 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:58:53.341459 6043 webserver.cc:460] Webserver started at http://127.18.70.129:36867/ using document root <none> and password file <none>
I20260812 06:58:53.342150 6043 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:53.342268 6043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:53.342551 6043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:53.345268 6043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "4074d53b66984b539e36d3abb5857199"
format_stamp: "Formatted at 2026-08-12 06:58:53 on dist-test-slave-tc2s"
server_key: "7c0bde5b1455c44bad47d226948f7946"
server_key_iv: "f07067350d075a65a554ba9580f4cfaf"
server_key_version: "encryptionkey@0"
I20260812 06:58:53.346021 6043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "4074d53b66984b539e36d3abb5857199"
format_stamp: "Formatted at 2026-08-12 06:58:53 on dist-test-slave-tc2s"
server_key: "7c0bde5b1455c44bad47d226948f7946"
server_key_iv: "f07067350d075a65a554ba9580f4cfaf"
server_key_version: "encryptionkey@0"
I20260812 06:58:53.350757 6043 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 06:58:53.353993 6071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:53.355213 6043 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 06:58:53.355343 6043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "4074d53b66984b539e36d3abb5857199"
format_stamp: "Formatted at 2026-08-12 06:58:53 on dist-test-slave-tc2s"
server_key: "7c0bde5b1455c44bad47d226948f7946"
server_key_iv: "f07067350d075a65a554ba9580f4cfaf"
server_key_version: "encryptionkey@0"
I20260812 06:58:53.355510 6043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:53.372640 6043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:53.376143 6043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:53.376400 6043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:53.377278 6043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:53.378752 6043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:53.378844 6043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:53.378968 6043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:53.379027 6043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:53.409695 6043 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:43725
I20260812 06:58:53.409752 6266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:43725 every 8 connection(s)
I20260812 06:58:53.411224 6043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:58:53.412300 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 6043
I20260812 06:58:53.412503 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:58:53.413324 18714 external_mini_cluster.cc:1428] Setting key 5621f4713e7fee61876df80cbea5536c
Aug 12 06:58:53 dist-test-slave-tc2s krb5kdc[5844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517933, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:53.432945 6272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:53.414387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:34449 (local address 127.18.70.190:34329)
0812 06:58:53.414871 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:53.414877 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:53.415904 (+ 1027us) server_negotiation.cc:407] Connection header received
0812 06:58:53.418229 (+ 2325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:53.418233 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:53.418304 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:53.418394 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:53.420196 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:53.420928 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:53.422968 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:53.423364 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:53.423458 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:53.427115 (+ 3657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:53.427121 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:53.427126 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:53.427165 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:53.430103 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:53.430760 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:53.430765 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:53.430769 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:53.430923 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:53.431304 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:53.431308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:53.431312 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:53.431642 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:53.431789 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:53.432392 (+ 603us) server_negotiation.cc:299] Negotiation successful
0812 06:58:53.432595 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":234,"threads_started":1}
I20260812 06:58:53.433699 6273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:53.414958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:34329 (local address 127.18.70.129:34449)
0812 06:58:53.415731 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:53.415780 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:53.417969 (+ 2189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:53.418644 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:53.418654 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:53.419313 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:53.420040 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:53.420064 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:53.421076 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:53.421082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:53.422836 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:53.422852 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:53.423576 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:53.423583 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:53.423861 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:53.424507 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:53.424540 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:53.426890 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:53.430225 (+ 3335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:53.430231 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:53.430243 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:53.430637 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:53.431025 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:53.431028 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:53.431031 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:53.431194 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:53.431739 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:53.431745 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:53.432040 (+ 295us) client_negotiation.cc:769] Sending connection context
0812 06:58:53.432250 (+ 210us) client_negotiation.cc:240] Negotiation successful
0812 06:58:53.432600 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":292,"threads_started":1}
I20260812 06:58:53.435169 6267 heartbeater.cc:347] Connected to a master server at 127.18.70.190:34329
I20260812 06:58:53.435488 6267 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:53.436389 6267 heartbeater.cc:511] Master 127.18.70.190:34329 requested a full tablet report, sending...
I20260812 06:58:53.438702 5930 ts_manager.cc:194] Registered new tserver with Master: 4074d53b66984b539e36d3abb5857199 (127.18.70.129:43725)
I20260812 06:58:53.440721 5930 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:34449
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 06:58:53.472373 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34329
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:53.796826 6276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:53.797102 6276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:53.797204 6276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:53.804288 6276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:53.804386 6276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:53.804502 6276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:58:53.814024 6276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:53.815282 6276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:53.816524 6276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:53.828927 6291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:53.828949 6289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:53.829614 6288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:53.830927 6276 server_base.cc:1034] running on GCE node
I20260812 06:58:53.831563 6276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:53.832499 6276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:53.833717 6276 hybrid_clock.cc:648] HybridClock initialized: now 1786517933833661 us; error 50 us; skew 500 ppm
I20260812 06:58:53.834052 6276 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:53 dist-test-slave-tc2s krb5kdc[5844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517933, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:53.837021 6276 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:58:53.838567 6276 webserver.cc:460] Webserver started at http://127.18.70.130:36311/ using document root <none> and password file <none>
I20260812 06:58:53.839282 6276 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:53.839389 6276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:53.839668 6276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:53.842729 6276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "794df562e45243b89ffd8a3d9862fd4f"
format_stamp: "Formatted at 2026-08-12 06:58:53 on dist-test-slave-tc2s"
server_key: "6badbe71bd76638ebd334537174b51cd"
server_key_iv: "135e80b90dffb437fd034a9f8637e62a"
server_key_version: "encryptionkey@0"
I20260812 06:58:53.843458 6276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "794df562e45243b89ffd8a3d9862fd4f"
format_stamp: "Formatted at 2026-08-12 06:58:53 on dist-test-slave-tc2s"
server_key: "6badbe71bd76638ebd334537174b51cd"
server_key_iv: "135e80b90dffb437fd034a9f8637e62a"
server_key_version: "encryptionkey@0"
I20260812 06:58:53.848490 6276 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 06:58:53.851845 6305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:53.853111 6276 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260812 06:58:53.853272 6276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "794df562e45243b89ffd8a3d9862fd4f"
format_stamp: "Formatted at 2026-08-12 06:58:53 on dist-test-slave-tc2s"
server_key: "6badbe71bd76638ebd334537174b51cd"
server_key_iv: "135e80b90dffb437fd034a9f8637e62a"
server_key_version: "encryptionkey@0"
I20260812 06:58:53.853488 6276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:53.877558 6276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:53.881711 6276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:53.882016 6276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:53.882964 6276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:53.884274 6276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:53.884347 6276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:53.884459 6276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:53.884506 6276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:53.914677 6276 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:44719
I20260812 06:58:53.914717 6502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:44719 every 8 connection(s)
I20260812 06:58:53.915939 6276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:58:53.922953 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 6276
I20260812 06:58:53.923099 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:58:53.923534 18714 external_mini_cluster.cc:1428] Setting key 4187945b975c49a497196f1d3d617be7
Aug 12 06:58:53 dist-test-slave-tc2s krb5kdc[5844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517933, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:53.935523 6272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:53.918335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:40499 (local address 127.18.70.190:34329)
0812 06:58:53.918513 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:53.918518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:53.919514 (+ 996us) server_negotiation.cc:407] Connection header received
0812 06:58:53.921348 (+ 1834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:53.921363 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:53.921450 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:53.921537 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:53.923189 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:53.924024 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:53.925758 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:53.926250 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:53.926376 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:53.930057 (+ 3681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:53.930062 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:53.930066 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:53.930100 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:53.932464 (+ 2364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:53.933241 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:53.933244 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:53.933246 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:53.933391 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:53.933820 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:53.933824 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:53.933825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:53.934124 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:53.934270 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:53.934957 (+ 687us) server_negotiation.cc:299] Negotiation successful
0812 06:58:53.935185 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 06:58:53.936457 6506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:53.918675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:34329 (local address 127.18.70.130:40499)
0812 06:58:53.919352 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:53.919389 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:53.921074 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:53.921781 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:53.921789 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:53.922424 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:53.923006 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:53.923029 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:53.924183 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:53.924188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:53.925611 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:53.925625 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:53.926471 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:53.926479 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:53.926694 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:53.927314 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:53.927336 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:53.929824 (+ 2488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:53.932602 (+ 2778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:53.932611 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:53.932626 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:53.933143 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:53.933495 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:53.933499 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:53.933502 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:53.933726 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:53.934260 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:53.934268 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:53.934594 (+ 326us) client_negotiation.cc:769] Sending connection context
0812 06:58:53.934832 (+ 238us) client_negotiation.cc:240] Negotiation successful
0812 06:58:53.935343 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":254,"threads_started":1}
I20260812 06:58:53.937767 6503 heartbeater.cc:347] Connected to a master server at 127.18.70.190:34329
I20260812 06:58:53.938148 6503 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:53.938982 6503 heartbeater.cc:511] Master 127.18.70.190:34329 requested a full tablet report, sending...
I20260812 06:58:53.940503 5930 ts_manager.cc:194] Registered new tserver with Master: 794df562e45243b89ffd8a3d9862fd4f (127.18.70.130:44719)
I20260812 06:58:53.941280 5930 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:40499
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 06:58:53.980628 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34329
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:58:54.304838 6510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:58:54.305106 6510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:58:54.305225 6510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:58:54.312306 6510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:58:54.312408 6510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:58:54.312577 6510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:58:54.321985 6510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:34329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:58:54.323216 6510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:58:54.324474 6510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:58:54.336622 6518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:54.336560 6519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:58:54.337046 6527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:58:54.337492 6510 server_base.cc:1034] running on GCE node
I20260812 06:58:54.338045 6510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:58:54.338864 6510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:58:54.340047 6510 hybrid_clock.cc:648] HybridClock initialized: now 1786517934340007 us; error 30 us; skew 500 ppm
I20260812 06:58:54.340327 6510 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:58:54 dist-test-slave-tc2s krb5kdc[5844](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517934, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:58:54.343333 6510 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:58:54.344609 6510 webserver.cc:460] Webserver started at http://127.18.70.131:40723/ using document root <none> and password file <none>
I20260812 06:58:54.345242 6510 fs_manager.cc:359] Metadata directory not provided
I20260812 06:58:54.345351 6510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:58:54.345635 6510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:58:54.348389 6510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "5e5344c61d914274ae2c138f15a91ce1"
format_stamp: "Formatted at 2026-08-12 06:58:54 on dist-test-slave-tc2s"
server_key: "042a9c886666c4f7a00c62f2110cf8fe"
server_key_iv: "edd8d431258dcfb65c4fd79558188b51"
server_key_version: "encryptionkey@0"
I20260812 06:58:54.349159 6510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "5e5344c61d914274ae2c138f15a91ce1"
format_stamp: "Formatted at 2026-08-12 06:58:54 on dist-test-slave-tc2s"
server_key: "042a9c886666c4f7a00c62f2110cf8fe"
server_key_iv: "edd8d431258dcfb65c4fd79558188b51"
server_key_version: "encryptionkey@0"
I20260812 06:58:54.354097 6510 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260812 06:58:54.357249 6541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:54.358585 6510 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 06:58:54.358711 6510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "5e5344c61d914274ae2c138f15a91ce1"
format_stamp: "Formatted at 2026-08-12 06:58:54 on dist-test-slave-tc2s"
server_key: "042a9c886666c4f7a00c62f2110cf8fe"
server_key_iv: "edd8d431258dcfb65c4fd79558188b51"
server_key_version: "encryptionkey@0"
I20260812 06:58:54.358886 6510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:58:54.387413 6510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:58:54.391110 6510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:58:54.391360 6510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:58:54.392190 6510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:58:54.393430 6510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:58:54.393500 6510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:54.393604 6510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:58:54.393651 6510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:58:54.423413 6510 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:44493
I20260812 06:58:54.423434 6747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:44493 every 8 connection(s)
I20260812 06:58:54.424629 6510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:58:54.434340 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 6510
I20260812 06:58:54.434540 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:58:54.435092 18714 external_mini_cluster.cc:1428] Setting key 2e00b6a24c4ceedd8a2648d83b26d2d4
Aug 12 06:58:54 dist-test-slave-tc2s krb5kdc[5844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517934, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:58:54.443735 6272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.427040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:56419 (local address 127.18.70.190:34329)
0812 06:58:54.427244 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:54.427250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:54.428363 (+ 1113us) server_negotiation.cc:407] Connection header received
0812 06:58:54.430137 (+ 1774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:54.430141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:54.430225 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:54.430304 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:54.431667 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.432421 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.433880 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.434315 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.434414 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.438484 (+ 4070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:54.438490 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:54.438493 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:54.438526 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:54.440853 (+ 2327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:54.441532 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:54.441536 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:54.441539 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:54.441664 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:54.442117 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:54.442121 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:54.442123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:54.442397 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:54.442531 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:54.443181 (+ 650us) server_negotiation.cc:299] Negotiation successful
0812 06:58:54.443399 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 06:58:54.443970 6267 heartbeater.cc:503] Master 127.18.70.190:34329 was elected leader, sending a full tablet report...
I20260812 06:58:54.444759 6751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.427542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:34329 (local address 127.18.70.131:56419)
0812 06:58:54.428217 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:54.428253 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:54.429833 (+ 1580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:54.430490 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:54.430496 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:54.430981 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:58:54.431532 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.431550 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.432553 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.432557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.433759 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.433771 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.434551 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.434561 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.434840 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.435530 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:58:54.435560 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:58:54.438273 (+ 2713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:58:54.440983 (+ 2710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:54.440992 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:54.441008 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:54.441420 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:54.441769 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:58:54.441774 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:58:54.441778 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:58:54.442010 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:58:54.442518 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:58:54.442526 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:58:54.442840 (+ 314us) client_negotiation.cc:769] Sending connection context
0812 06:58:54.443062 (+ 222us) client_negotiation.cc:240] Negotiation successful
0812 06:58:54.443562 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":270,"threads_started":1}
I20260812 06:58:54.446019 6748 heartbeater.cc:347] Connected to a master server at 127.18.70.190:34329
I20260812 06:58:54.446276 6748 heartbeater.cc:464] Registering TS with master...
I20260812 06:58:54.446931 6748 heartbeater.cc:511] Master 127.18.70.190:34329 requested a full tablet report, sending...
I20260812 06:58:54.448170 5930 ts_manager.cc:194] Registered new tserver with Master: 5e5344c61d914274ae2c138f15a91ce1 (127.18.70.131:44493)
I20260812 06:58:54.448957 5930 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:56419
I20260812 06:58:54.450524 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:58:54.466603 6272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.454995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42668 (local address 127.18.70.190:34329)
0812 06:58:54.455146 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:54.455153 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:54.455543 (+ 390us) server_negotiation.cc:407] Connection header received
0812 06:58:54.455699 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:54.455704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:54.455766 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:54.455844 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:54.457292 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.458069 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.459348 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.459754 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.459839 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.461855 (+ 2016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:54.461860 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:54.461863 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:54.461925 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:54.464393 (+ 2468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:54.464960 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:54.464964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:54.464966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:54.465085 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:54.465347 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:54.465350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:54.465352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:54.465636 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:54.465817 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:54.466129 (+ 312us) server_negotiation.cc:299] Negotiation successful
0812 06:58:54.466304 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:58:54.470127 5930 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42668:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:58:54.476764 5930 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:58:54.513599 6770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.488272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60704 (local address 127.18.70.129:43725)
0812 06:58:54.503508 (+ 15236us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:54.503517 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:54.505188 (+ 1671us) server_negotiation.cc:407] Connection header received
0812 06:58:54.505301 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:54.505309 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:54.505571 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:54.505759 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:54.506615 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.508125 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.510846 (+ 2721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.512058 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.512191 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.512423 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:54.513101 (+ 678us) server_negotiation.cc:299] Negotiation successful
0812 06:58:54.513268 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15038,"thread_start_us":15254,"threads_started":1}
I20260812 06:58:54.513626 6771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.487996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43725 (local address 127.0.0.1:60704)
0812 06:58:54.504751 (+ 16755us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:54.504788 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:54.504983 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:54.506073 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:54.506079 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:54.506103 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:54.506432 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.506441 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.508289 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.508294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.510692 (+ 2398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.510705 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.512539 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.512546 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.512766 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.512858 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 06:58:54.513006 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 06:58:54.513181 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16520,"mutex_wait_us":24,"thread_start_us":18678,"threads_started":1}
I20260812 06:58:54.514894 6767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.488150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:44493 (local address 127.0.0.1:44940)
0812 06:58:54.506949 (+ 18799us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:54.506969 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:54.507163 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:54.507967 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:54.507972 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:54.507995 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:54.508460 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.508476 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.510419 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.510432 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.512436 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.512451 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.514181 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.514188 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.514340 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.514373 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 06:58:54.514457 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 06:58:54.514575 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18663,"thread_start_us":20731,"threads_started":1}
I20260812 06:58:54.514994 6774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.488984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44940 (local address 127.18.70.131:44493)
0812 06:58:54.504220 (+ 15236us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:54.504230 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:54.507062 (+ 2832us) server_negotiation.cc:407] Connection header received
0812 06:58:54.507335 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:54.507343 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:54.507532 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:54.507685 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:54.508671 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.510283 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.512602 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.513973 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.514093 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.514296 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:54.514518 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 06:58:54.514669 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15067,"thread_start_us":14922,"threads_started":1}
I20260812 06:58:54.517584 6769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.488553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:44719 (local address 127.0.0.1:49792)
0812 06:58:54.508952 (+ 20399us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:54.508978 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:54.509103 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:54.509640 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:54.509645 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:54.509668 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:54.510076 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.510086 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.511955 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.511960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.514133 (+ 2173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.514147 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.516850 (+ 2703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.516857 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.517023 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.517051 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 06:58:54.517121 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:58:54.517234 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20259,"mutex_wait_us":1,"thread_start_us":15837,"threads_started":1}
I20260812 06:58:54.517664 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.488799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49792 (local address 127.18.70.130:44719)
0812 06:58:54.508488 (+ 19689us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:54.508496 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:54.509143 (+ 647us) server_negotiation.cc:407] Connection header received
0812 06:58:54.509254 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:54.509261 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:54.509461 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:54.509630 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:54.510240 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.511775 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.514310 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.516657 (+ 2347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.516782 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.516979 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:54.517192 (+ 213us) server_negotiation.cc:299] Negotiation successful
0812 06:58:54.517357 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19515,"thread_start_us":20375,"threads_started":1}
I20260812 06:58:54.517361 6159 tablet_service.cc:1467] Processing CreateTablet for tablet 4ab696dd6a2c44999d6ce5ef9a916ac2 (DEFAULT_TABLE table=test-table [id=35d4f297e673426eacf55289b66c804a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:54.518873 6159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ab696dd6a2c44999d6ce5ef9a916ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:54.520344 6622 tablet_service.cc:1467] Processing CreateTablet for tablet 4ab696dd6a2c44999d6ce5ef9a916ac2 (DEFAULT_TABLE table=test-table [id=35d4f297e673426eacf55289b66c804a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:54.521133 6385 tablet_service.cc:1467] Processing CreateTablet for tablet 4ab696dd6a2c44999d6ce5ef9a916ac2 (DEFAULT_TABLE table=test-table [id=35d4f297e673426eacf55289b66c804a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:58:54.521703 6622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ab696dd6a2c44999d6ce5ef9a916ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:54.522446 6385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ab696dd6a2c44999d6ce5ef9a916ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:58:54.530202 6777 tablet_bootstrap.cc:492] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: Bootstrap starting.
I20260812 06:58:54.533761 6777 tablet_bootstrap.cc:654] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:54.535008 6778 tablet_bootstrap.cc:492] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: Bootstrap starting.
I20260812 06:58:54.535135 6777 log.cc:824] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:54.537530 6782 tablet_bootstrap.cc:492] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: Bootstrap starting.
I20260812 06:58:54.538368 6778 tablet_bootstrap.cc:654] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:54.538393 6777 tablet_bootstrap.cc:492] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: No bootstrap required, opened a new log
I20260812 06:58:54.538645 6777 ts_tablet_manager.cc:1397] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 06:58:54.539345 6778 log.cc:824] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:54.540864 6782 tablet_bootstrap.cc:654] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: Neither blocks nor log segments found. Creating new log.
I20260812 06:58:54.541693 6778 tablet_bootstrap.cc:492] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: No bootstrap required, opened a new log
I20260812 06:58:54.541978 6778 ts_tablet_manager.cc:1397] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260812 06:58:54.542032 6782 log.cc:824] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:58:54.544893 6782 tablet_bootstrap.cc:492] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: No bootstrap required, opened a new log
I20260812 06:58:54.545135 6782 ts_tablet_manager.cc:1397] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 06:58:54.548534 6777 raft_consensus.cc:348] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4074d53b66984b539e36d3abb5857199" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43725 } } peers { permanent_uuid: "5e5344c61d914274ae2c138f15a91ce1" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 44493 } } peers { permanent_uuid: "794df562e45243b89ffd8a3d9862fd4f" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 44719 } }
I20260812 06:58:54.548985 6777 raft_consensus.cc:374] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:54.549085 6777 raft_consensus.cc:729] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4074d53b66984b539e36d3abb5857199, State: Initialized, Role: FOLLOWER
I20260812 06:58:54.549674 6778 raft_consensus.cc:348] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4074d53b66984b539e36d3abb5857199" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43725 } } peers { permanent_uuid: "5e5344c61d914274ae2c138f15a91ce1" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 44493 } } peers { permanent_uuid: "794df562e45243b89ffd8a3d9862fd4f" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 44719 } }
I20260812 06:58:54.549690 6777 consensus_queue.cc:260] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4074d53b66984b539e36d3abb5857199" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43725 } } peers { permanent_uuid: "5e5344c61d914274ae2c138f15a91ce1" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 44493 } } peers { permanent_uuid: "794df562e45243b89ffd8a3d9862fd4f" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 44719 } }
I20260812 06:58:54.550030 6778 raft_consensus.cc:374] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:54.550127 6778 raft_consensus.cc:729] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e5344c61d914274ae2c138f15a91ce1, State: Initialized, Role: FOLLOWER
I20260812 06:58:54.550825 6778 consensus_queue.cc:260] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4074d53b66984b539e36d3abb5857199" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43725 } } peers { permanent_uuid: "5e5344c61d914274ae2c138f15a91ce1" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 44493 } } peers { permanent_uuid: "794df562e45243b89ffd8a3d9862fd4f" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 44719 } }
I20260812 06:58:54.551450 6777 ts_tablet_manager.cc:1428] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260812 06:58:54.552428 6748 heartbeater.cc:503] Master 127.18.70.190:34329 was elected leader, sending a full tablet report...
I20260812 06:58:54.554194 6778 ts_tablet_manager.cc:1428] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
I20260812 06:58:54.555279 6782 raft_consensus.cc:348] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4074d53b66984b539e36d3abb5857199" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43725 } } peers { permanent_uuid: "5e5344c61d914274ae2c138f15a91ce1" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 44493 } } peers { permanent_uuid: "794df562e45243b89ffd8a3d9862fd4f" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 44719 } }
I20260812 06:58:54.555676 6782 raft_consensus.cc:374] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:58:54.555780 6782 raft_consensus.cc:729] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 794df562e45243b89ffd8a3d9862fd4f, State: Initialized, Role: FOLLOWER
I20260812 06:58:54.556371 6782 consensus_queue.cc:260] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4074d53b66984b539e36d3abb5857199" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43725 } } peers { permanent_uuid: "5e5344c61d914274ae2c138f15a91ce1" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 44493 } } peers { permanent_uuid: "794df562e45243b89ffd8a3d9862fd4f" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 44719 } }
I20260812 06:58:54.557629 6503 heartbeater.cc:503] Master 127.18.70.190:34329 was elected leader, sending a full tablet report...
I20260812 06:58:54.558393 6782 ts_tablet_manager.cc:1428] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260812 06:58:54.664120 6271 tablet.cc:2369] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:58:54.667759 6504 tablet.cc:2369] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:58:54.676100 6750 tablet.cc:2369] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:58:54.931767 6785 raft_consensus.cc:482] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:58:54.932055 6785 raft_consensus.cc:504] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4074d53b66984b539e36d3abb5857199" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43725 } } peers { permanent_uuid: "5e5344c61d914274ae2c138f15a91ce1" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 44493 } } peers { permanent_uuid: "794df562e45243b89ffd8a3d9862fd4f" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 44719 } }
I20260812 06:58:54.933734 6785 leader_election.cc:288] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e5344c61d914274ae2c138f15a91ce1 (127.18.70.131:44493), 794df562e45243b89ffd8a3d9862fd4f (127.18.70.130:44719)
I20260812 06:58:54.940014 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.934137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:39185 (local address 127.18.70.130:44719)
0812 06:58:54.934350 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:54.934357 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:54.934907 (+ 550us) server_negotiation.cc:407] Connection header received
0812 06:58:54.935076 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:54.935082 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:54.935143 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:54.935218 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:54.935826 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.936528 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.938299 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.939064 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.939202 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.939277 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:54.939636 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 06:58:54.939770 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 06:58:54.940028 6774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.934157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:40551 (local address 127.18.70.131:44493)
0812 06:58:54.934446 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:54.934452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:54.934846 (+ 394us) server_negotiation.cc:407] Connection header received
0812 06:58:54.935033 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:54.935037 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:54.935095 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:54.935167 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:58:54.935743 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.936462 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.938303 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.939045 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.939190 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.939266 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:54.939640 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 06:58:54.939768 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165}
I20260812 06:58:54.940204 6790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.934133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:44719 (local address 127.18.70.129:39185)
0812 06:58:54.934806 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:54.934820 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:54.934943 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:54.935245 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:54.935249 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:54.935273 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:54.935682 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.935692 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.936661 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.936665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.938152 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.938165 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.939313 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.939318 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.939474 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.939515 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 06:58:54.939595 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:58:54.939770 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"mutex_wait_us":54,"thread_start_us":409,"threads_started":1}
I20260812 06:58:54.940232 6789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:54.934024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:44493 (local address 127.18.70.129:40551)
0812 06:58:54.934734 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0812 06:58:54.934751 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 06:58:54.934893 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:58:54.935197 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:58:54.935201 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:58:54.935230 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:58:54.935600 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.935610 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.936587 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.936592 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.938161 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:58:54.938174 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:58:54.939275 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:58:54.939282 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:58:54.939471 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:54.939521 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 06:58:54.939598 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 06:58:54.939769 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"mutex_wait_us":98,"thread_start_us":330,"threads_started":1}
I20260812 06:58:54.941282 6653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ab696dd6a2c44999d6ce5ef9a916ac2" candidate_uuid: "4074d53b66984b539e36d3abb5857199" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e5344c61d914274ae2c138f15a91ce1" is_pre_election: true
I20260812 06:58:54.941285 6424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ab696dd6a2c44999d6ce5ef9a916ac2" candidate_uuid: "4074d53b66984b539e36d3abb5857199" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "794df562e45243b89ffd8a3d9862fd4f" is_pre_election: true
I20260812 06:58:54.941823 6653 raft_consensus.cc:2454] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4074d53b66984b539e36d3abb5857199 in term 0.
I20260812 06:58:54.941823 6424 raft_consensus.cc:2454] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4074d53b66984b539e36d3abb5857199 in term 0.
I20260812 06:58:54.942483 6076 leader_election.cc:302] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4074d53b66984b539e36d3abb5857199, 794df562e45243b89ffd8a3d9862fd4f; no voters:
I20260812 06:58:54.942881 6785 raft_consensus.cc:2781] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:58:54.943022 6785 raft_consensus.cc:482] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:58:54.943114 6785 raft_consensus.cc:3037] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:54.945261 6785 raft_consensus.cc:504] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4074d53b66984b539e36d3abb5857199" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43725 } } peers { permanent_uuid: "5e5344c61d914274ae2c138f15a91ce1" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 44493 } } peers { permanent_uuid: "794df562e45243b89ffd8a3d9862fd4f" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 44719 } }
I20260812 06:58:54.945844 6785 leader_election.cc:288] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [CANDIDATE]: Term 1 election: Requested vote from peers 5e5344c61d914274ae2c138f15a91ce1 (127.18.70.131:44493), 794df562e45243b89ffd8a3d9862fd4f (127.18.70.130:44719)
I20260812 06:58:54.946266 6424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ab696dd6a2c44999d6ce5ef9a916ac2" candidate_uuid: "4074d53b66984b539e36d3abb5857199" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "794df562e45243b89ffd8a3d9862fd4f"
I20260812 06:58:54.946277 6653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ab696dd6a2c44999d6ce5ef9a916ac2" candidate_uuid: "4074d53b66984b539e36d3abb5857199" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e5344c61d914274ae2c138f15a91ce1"
I20260812 06:58:54.946429 6653 raft_consensus.cc:3037] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:54.946440 6424 raft_consensus.cc:3037] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:58:54.948521 6653 raft_consensus.cc:2454] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4074d53b66984b539e36d3abb5857199 in term 1.
I20260812 06:58:54.948534 6424 raft_consensus.cc:2454] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4074d53b66984b539e36d3abb5857199 in term 1.
I20260812 06:58:54.948899 6076 leader_election.cc:302] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4074d53b66984b539e36d3abb5857199, 794df562e45243b89ffd8a3d9862fd4f; no voters:
I20260812 06:58:54.949244 6785 raft_consensus.cc:2781] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:58:54.949612 6785 raft_consensus.cc:686] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 1 LEADER]: Becoming Leader. State: Replica: 4074d53b66984b539e36d3abb5857199, State: Running, Role: LEADER
I20260812 06:58:54.950130 6785 consensus_queue.cc:237] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4074d53b66984b539e36d3abb5857199" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43725 } } peers { permanent_uuid: "5e5344c61d914274ae2c138f15a91ce1" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 44493 } } peers { permanent_uuid: "794df562e45243b89ffd8a3d9862fd4f" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 44719 } }
I20260812 06:58:54.954720 5930 catalog_manager.cc:5495] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4074d53b66984b539e36d3abb5857199 (127.18.70.129). New cstate: current_term: 1 leader_uuid: "4074d53b66984b539e36d3abb5857199" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4074d53b66984b539e36d3abb5857199" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e5344c61d914274ae2c138f15a91ce1" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 44493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "794df562e45243b89ffd8a3d9862fd4f" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 44719 } health_report { overall_health: UNKNOWN } } }
I20260812 06:58:55.076021 6797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:55.070738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60708 (local address 127.18.70.129:43725)
0812 06:58:55.071243 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:55.071248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:55.071340 (+ 92us) server_negotiation.cc:407] Connection header received
0812 06:58:55.071523 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:55.071526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:55.071625 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:55.071760 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:58:55.072123 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:55.072791 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:55.074150 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:55.074542 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:55.074631 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:55.075033 (+ 402us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:58:55.075531 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:58:55.075635 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:55.075677 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 06:58:55.075740 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":269,"threads_started":1}
I20260812 06:58:55.083669 6653 raft_consensus.cc:1261] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1 [term 1 FOLLOWER]: Refusing update from remote peer 4074d53b66984b539e36d3abb5857199: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:55.083670 6424 raft_consensus.cc:1261] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f [term 1 FOLLOWER]: Refusing update from remote peer 4074d53b66984b539e36d3abb5857199: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:58:55.084537 6791 consensus_queue.cc:1035] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e5344c61d914274ae2c138f15a91ce1" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 44493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:55.084860 6785 consensus_queue.cc:1035] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [LEADER]: Connected to new peer: Peer: permanent_uuid: "794df562e45243b89ffd8a3d9862fd4f" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 44719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:58:55.098795 6806 mvcc.cc:205] Tried to move back new op lower bound from 7317577462093324288 to 7317577461559197696. Current Snapshot: MvccSnapshot[applied={T|T < 7317577462093324288 or (T in {7317577462093324288})}]
I20260812 06:58:55.099160 6807 mvcc.cc:205] Tried to move back new op lower bound from 7317577462093324288 to 7317577461559197696. Current Snapshot: MvccSnapshot[applied={T|T < 7317577462093324288}]
I20260812 06:58:55.109253 5930 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42668:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:55.109464 5930 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42668:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:58:55.112788 5930 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ce6ee180515a4e469b051f699cfa468f: Sending DeleteTablet for 3 replicas of tablet 4ab696dd6a2c44999d6ce5ef9a916ac2
I20260812 06:58:55.113816 6159 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ab696dd6a2c44999d6ce5ef9a916ac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:55 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:60704
I20260812 06:58:55.113847 6622 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ab696dd6a2c44999d6ce5ef9a916ac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:55 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:44940
I20260812 06:58:55.114187 6385 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ab696dd6a2c44999d6ce5ef9a916ac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:58:55 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:49792
I20260812 06:58:55.116153 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 6043
I20260812 06:58:55.126173 6819 tablet_replica.cc:330] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: stopping tablet replica
I20260812 06:58:55.126793 6819 raft_consensus.cc:2229] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:58:55.127645 6819 raft_consensus.cc:2258] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:55.129678 6819 ts_tablet_manager.cc:1905] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:55.137723 6819 ts_tablet_manager.cc:1918] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:55.137979 6819 log.cc:1196] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/4ab696dd6a2c44999d6ce5ef9a916ac2
I20260812 06:58:55.138634 6819 ts_tablet_manager.cc:1939] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 4074d53b66984b539e36d3abb5857199: Deleting consensus metadata
I20260812 06:58:55.140759 5904 catalog_manager.cc:4841] TS 4074d53b66984b539e36d3abb5857199 (127.18.70.129:43725): tablet 4ab696dd6a2c44999d6ce5ef9a916ac2 (table test-table [id=35d4f297e673426eacf55289b66c804a]) successfully deleted
I20260812 06:58:55.142628 6822 tablet_replica.cc:330] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: stopping tablet replica
I20260812 06:58:55.142853 6821 tablet_replica.cc:330] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: stopping tablet replica
I20260812 06:58:55.143256 6821 raft_consensus.cc:2229] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:55.143227 6822 raft_consensus.cc:2229] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:58:55.143743 6822 raft_consensus.cc:2258] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:55.143743 6821 raft_consensus.cc:2258] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:58:55.145591 6822 ts_tablet_manager.cc:1905] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:58:55.151233 6821 ts_tablet_manager.cc:1905] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 06:58:55 dist-test-slave-tc2s krb5kdc[5844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:58:55.152520 6822 ts_tablet_manager.cc:1918] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:55.152761 6822 log.cc:1196] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/4ab696dd6a2c44999d6ce5ef9a916ac2
I20260812 06:58:55.153332 6822 ts_tablet_manager.cc:1939] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 794df562e45243b89ffd8a3d9862fd4f: Deleting consensus metadata
I20260812 06:58:55.155611 5903 catalog_manager.cc:4841] TS 794df562e45243b89ffd8a3d9862fd4f (127.18.70.130:44719): tablet 4ab696dd6a2c44999d6ce5ef9a916ac2 (table test-table [id=35d4f297e673426eacf55289b66c804a]) successfully deleted
I20260812 06:58:55.158280 6821 ts_tablet_manager.cc:1918] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:58:55.158432 6821 log.cc:1196] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/4ab696dd6a2c44999d6ce5ef9a916ac2
I20260812 06:58:55.158937 6821 ts_tablet_manager.cc:1939] T 4ab696dd6a2c44999d6ce5ef9a916ac2 P 5e5344c61d914274ae2c138f15a91ce1: Deleting consensus metadata
I20260812 06:58:55.160528 5900 catalog_manager.cc:4841] TS 5e5344c61d914274ae2c138f15a91ce1 (127.18.70.131:44493): tablet 4ab696dd6a2c44999d6ce5ef9a916ac2 (table test-table [id=35d4f297e673426eacf55289b66c804a]) successfully deleted
I20260812 06:58:55.161041 6797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:55.117835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60718 (local address 127.18.70.129:43725)
0812 06:58:55.118039 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:55.118046 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:55.140897 (+ 22851us) server_negotiation.cc:407] Connection header received
0812 06:58:55.141393 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:55.141398 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:55.141478 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:55.141585 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:55.143311 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:55.144408 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:55.146111 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:55.146760 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:55.146890 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:55.152401 (+ 5511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:55.152416 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:55.152432 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:55.152475 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:55.157307 (+ 4832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:55.158231 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:55.158240 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:55.158243 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:55.158414 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:55.158940 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:55.158945 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:55.158949 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:55.159408 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:55.159713 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:55.160392 (+ 679us) server_negotiation.cc:299] Negotiation successful
0812 06:58:55.160643 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 06:58:55.161712 6259 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:55.261686 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 6043
I20260812 06:58:55.286593 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 6276
Aug 12 06:58:55 dist-test-slave-tc2s krb5kdc[5844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 06:58:55.301411 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:55.287418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49798 (local address 127.18.70.130:44719)
0812 06:58:55.287601 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:55.287606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:55.287625 (+ 19us) server_negotiation.cc:407] Connection header received
0812 06:58:55.287685 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:55.287689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:55.287761 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:55.287854 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:55.289227 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:55.290084 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:55.291396 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:55.291819 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:55.291937 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:55.296148 (+ 4211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:55.296164 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:55.296181 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:55.296216 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:55.298894 (+ 2678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:55.299590 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:55.299598 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:55.299600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:55.299770 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:55.300071 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:55.300073 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:55.300076 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:55.300491 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:55.300726 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:55.300946 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 06:58:55.301131 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 06:58:55.302223 6494 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:55.394236 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 6276
I20260812 06:58:55.421226 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 6510
Aug 12 06:58:55 dist-test-slave-tc2s krb5kdc[5844](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 06:58:55.438876 6774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:58:55.422054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44956 (local address 127.18.70.131:44493)
0812 06:58:55.422233 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 06:58:55.422239 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:58:55.422259 (+ 20us) server_negotiation.cc:407] Connection header received
0812 06:58:55.422369 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:58:55.422374 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:58:55.422443 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:58:55.422528 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:58:55.423805 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:55.425053 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:55.426414 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:58:55.427095 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:58:55.427223 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:58:55.431860 (+ 4637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:58:55.431876 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:58:55.431894 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:58:55.431955 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:58:55.436006 (+ 4051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:55.436703 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:55.436712 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:55.436716 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:55.436872 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:58:55.437220 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:58:55.437225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:58:55.437228 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:58:55.437700 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:58:55.438058 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0812 06:58:55.438262 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 06:58:55.438514 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 06:58:55.439630 6740 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:55.529335 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 6510
I20260812 06:58:55.554916 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 5864
I20260812 06:58:55.556113 5986 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:58:55.666091 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 5864
2026-08-12T06:58:55Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4747 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:58:55 dist-test-slave-tc2s krb5kdc[6837](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:58:55 dist-test-slave-tc2s krb5kdc[6837](info): set up 2 sockets
Aug 12 06:58:55 dist-test-slave-tc2s krb5kdc[6837](info): commencing operation
krb5kdc: starting...
W20260812 06:58:56.956241 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:58:57 dist-test-slave-tc2s krb5kdc[6837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:58:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:58:57Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.18.70.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.18.70.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/rangeradmin_127.18.70.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/rangeradmin_127.18.70.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.18.70.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.18.70.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/rangerlookup_127.18.70.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/rangerlookup_127.18.70.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.70.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.18.70.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/HTTP_127.18.70.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/HTTP_127.18.70.148@KRBTEST.COM.keytab.
I20260812 06:58:57.315217 18714 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskGv53JZ/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/postgres -l logfile start
2026-08-12 06:58:59.532 UTC [6894] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 06:58:59.532 UTC [6894] LOG: listening on IPv4 address "127.18.70.148", port 55597
2026-08-12 06:58:59.535 UTC [6894] LOG: listening on Unix socket "/tmp/.s.PGSQL.55597"
2026-08-12 06:58:59.556 UTC [6901] LOG: database system was shut down at 2026-08-12 06:58:58 UTC
2026-08-12 06:58:59.559 UTC [6894] LOG: database system is ready to accept connections
I20260812 06:59:00.700757 18714 mini_postgres.cc:96] Postgres bound to 55597
2026-08-12 06:59:00.724 UTC [6919] FATAL: database "slave" does not exist
127.18.70.148:55597 - accepting connections
I20260812 06:59:00.725541 18714 mini_ranger.cc:161] Starting Ranger...
I20260812 06:59:00.758569 18714 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 06:59:01.187194 18714 mini_ranger.cc:87] Created ranger Postgres database
I20260812 06:59:01.187376 18714 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-admin
2026-08-12 06:59:01,499 [I] DB FLAVOR :POSTGRES
2026-08-12 06:59:01,500 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:59:01,500 [I] Checking connection..
2026-08-12 06:59:01,500 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 06:59:01,738 [I] Checking connection passed.
2026-08-12 06:59:01,738 [I] --------- Verifying version history table ---------
2026-08-12 06:59:01,738 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:59:01,980 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:59:01,980 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:59:02,227 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:59:02,228 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 06:59:02,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 06:59:02.489 UTC [7022] WARNING: there is no transaction in progress
2026-08-12 06:59:02,499 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 06:59:02,500 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:59:02,771 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 06:59:02,771 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:59:02,771 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 06:59:03,025 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 06:59:03,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-tc2s.c.gcp-upstream.internal','N') ;"
2026-08-12 06:59:03,533 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:59:03,781 [I] Table x_portal_user does not exist in database ranger
2026-08-12 06:59:03,781 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:59:04,033 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 06:59:04,033 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:59:04,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:59:04,541 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 06:59:04,542 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 06:59:05.458 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.474 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.489 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.505 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.520 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.537 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.592 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.598 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.612 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.621 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.632 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.645 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.655 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.661 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.668 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:05.674 UTC [7219] WARNING: there is no transaction in progress
2026-08-12 06:59:06,232 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 06:59:06,233 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 06:59:06,473 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 06:59:06,473 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:59:06,730 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 06:59:06,731 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:59:06,976 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 06:59:06,977 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:59:07,217 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:59:07,453 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-tc2s.c.gcp-upstream.internal';"
2026-08-12 06:59:07,674 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 06:59:07,674 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 06:59:07,926 [I] DB_PATCHES have already been applied
I20260812 06:59:07.932685 18714 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-admin:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskGv53JZ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 06:59:07.932793 18714 mini_ranger.cc:193] Using host: 127.18.70.148
I20260812 06:59:07.950302 18714 mini_ranger.cc:227] Ranger admin URL: http://127.18.70.148:39845
Aug 12, 2026 6:59:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:59:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:59:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 6:59:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 6:59:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 6:59:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 6:59:08 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 06:59:09.292552 18714 mini_ranger.cc:160] Time spent starting Ranger: real 8.567s user 0.000s sys 0.053s
Aug 12, 2026 6:59:28 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 6:59:28 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 6:59:28 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 6:59:28 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 6:59:29 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 06:59:29.776355 18714 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.18.70.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.18.70.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/rangerkms_127.18.70.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/rangerkms_127.18.70.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.70.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.18.70.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.70.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/HTTP_127.18.70.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.70.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/HTTP_127.18.70.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 06:59:29 dist-test-slave-tc2s krb5kdc[6837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517969, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 06:59:29.933332 18714 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 06:59:29.952791 18714 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 06:59:30.663606 18714 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 06:59:30.663757 18714 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-kms
I20260812 06:59:30.663918 18714 mini_ranger_kms.cc:227] Using postgres at 127.18.70.148:55597
2026-08-12 06:59:31,202 [I] DB FLAVOR :POSTGRES
2026-08-12 06:59:31,203 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:59:31,203 [I] Checking connection
2026-08-12 06:59:31,203 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 06:59:31,457 [I] connection success
2026-08-12 06:59:31,457 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 06:59:31,457 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 06:59:31,457 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 06:59:31,678 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 06:59:31,678 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:59:31,678 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 06:59:31,679 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:55597/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 06:59:31,929 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 06:59:32.385157 18714 mini_ranger_kms.cc:310] Created kms service
I20260812 06:59:32.577318 18714 mini_ranger_kms.cc:326] Created kudu user
I20260812 06:59:32.619017 18714 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 06:59:32 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517969, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 06:59:32.992496 18714 mini_ranger_kms.cc:384] Added ranger policy
I20260812 06:59:32.993999 18714 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-kms:/tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 06:59:32.994071 18714 mini_ranger_kms.cc:240] Using host: 127.18.70.148
I20260812 06:59:33.018756 18714 mini_ranger_kms.cc:276] Ranger KMS PID: 7559
I20260812 06:59:33.018970 18714 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.18.70.148:60215
Aug 12, 2026 6:59:34 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:59:34 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:59:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 6:59:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 6:59:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 6:59:34 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 06:59:35 dist-test-slave-tc2s krb5kdc[6837](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786517975, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.70.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:59:35.676765 18714 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.743s user 0.113s sys 0.443s
I20260812 06:59:35.677107 18714 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 06:59:35.677341 18714 mini_ranger_kms.cc:401] 127.18.70.148:60215/kms/v1/keys
Aug 12 06:59:35 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517975, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.70.148@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
Aug 12 06:59:36 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517975, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.70.148@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
Aug 12 06:59:38 dist-test-slave-tc2s krb5kdc[6837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 06:59:38.347316 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46051
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:40565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:46051
--ranger_config_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:60215/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:59:38.675652 7649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:59:38.675926 7649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:59:38.676049 7649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:59:38.683194 7649 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:59:38.683296 7649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:59:38.683372 7649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:59:38.683447 7649 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:59:38.683514 7649 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:59:38.693436 7649 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:40565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/wal
--ranger_kms_url=127.18.70.148:60215/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:46051
--ranger_config_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:59:38.694664 7649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:59:38.695931 7649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:59:38.707599 7655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:59:38.707628 7657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:59:38.708027 7654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:59:38.709338 7649 server_base.cc:1034] running on GCE node
I20260812 06:59:38.710116 7649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:59:38.711421 7649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:59:38.712620 7649 hybrid_clock.cc:648] HybridClock initialized: now 1786517978712574 us; error 35 us; skew 500 ppm
I20260812 06:59:38.712930 7649 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:59:38 dist-test-slave-tc2s krb5kdc[6837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517978, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:59:38.719152 7649 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 06:59:38.720562 7649 webserver.cc:460] Webserver started at http://127.18.70.190:40009/ using document root <none> and password file <none>
I20260812 06:59:38.721144 7649 fs_manager.cc:359] Metadata directory not provided
I20260812 06:59:38.721249 7649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:59:38.721511 7649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:59:38 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517978, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 06:59:38.780951 7649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "32ae5d583ffa44e6bf0a3519ddbab830"
format_stamp: "Formatted at 2026-08-12 06:59:38 on dist-test-slave-tc2s"
server_key: "46333a0aa87444a53f5923d65532b2b6"
server_key_iv: "8d803e558c267698ba58716ffb0ea9ff"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:38.781798 7649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "32ae5d583ffa44e6bf0a3519ddbab830"
format_stamp: "Formatted at 2026-08-12 06:59:38 on dist-test-slave-tc2s"
server_key: "46333a0aa87444a53f5923d65532b2b6"
server_key_iv: "8d803e558c267698ba58716ffb0ea9ff"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:38.787108 7649 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 06:59:38.805382 7669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:59:38.807106 7649 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260812 06:59:38.807301 7649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "32ae5d583ffa44e6bf0a3519ddbab830"
format_stamp: "Formatted at 2026-08-12 06:59:38 on dist-test-slave-tc2s"
server_key: "46333a0aa87444a53f5923d65532b2b6"
server_key_iv: "8d803e558c267698ba58716ffb0ea9ff"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:38.807562 7649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:59:38.835597 7649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:59:38.839031 7649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:59:38.839282 7649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:59:38.856469 7649 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:46051
I20260812 06:59:38.856503 7756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:46051 every 8 connection(s)
I20260812 06:59:38.857717 7649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 06:59:38.861330 7759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:59:38.862674 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 7649
I20260812 06:59:38.862884 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 06:59:38.863739 18714 external_mini_cluster.cc:1428] Setting key 6c191020825e6e8f157309fc7f18989c
I20260812 06:59:38.874938 7759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830: Bootstrap starting.
Aug 12 06:59:38 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:59:38.878364 7759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830: Neither blocks nor log segments found. Creating new log.
I20260812 06:59:38.879356 7759 log.cc:824] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830: Log is configured to *not* fsync() on all Append() calls
I20260812 06:59:38.882033 7759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830: No bootstrap required, opened a new log
I20260812 06:59:38.885077 7762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:38.865740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35382 (local address 127.18.70.190:46051)
0812 06:59:38.866556 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:38.866567 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:38.866610 (+ 43us) server_negotiation.cc:407] Connection header received
0812 06:59:38.868178 (+ 1568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:38.868200 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:38.868557 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:38.868851 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:59:38.870325 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:38.871639 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:38.873345 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:38.874021 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:38.874141 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:38.878333 (+ 4192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:59:38.878341 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:59:38.878358 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:59:38.878392 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:59:38.881278 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:38.881937 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:38.881945 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:38.881951 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:38.882125 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:38.882481 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:38.882487 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:38.882490 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:38.883002 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:59:38.883296 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:38.883753 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 06:59:38.884129 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":401,"threads_started":1}
I20260812 06:59:38.889592 7759 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ae5d583ffa44e6bf0a3519ddbab830" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46051 } }
I20260812 06:59:38.889973 7759 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:59:38.890057 7759 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ae5d583ffa44e6bf0a3519ddbab830, State: Initialized, Role: FOLLOWER
I20260812 06:59:38.890515 7759 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ae5d583ffa44e6bf0a3519ddbab830" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46051 } }
I20260812 06:59:38.890713 7759 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:59:38.890805 7759 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:59:38.890933 7759 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:59:38.893143 7759 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ae5d583ffa44e6bf0a3519ddbab830" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46051 } }
I20260812 06:59:38.893548 7759 leader_election.cc:302] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32ae5d583ffa44e6bf0a3519ddbab830; no voters:
I20260812 06:59:38.894047 7759 leader_election.cc:288] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:59:38.894163 7765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:59:38.895306 7765 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [term 1 LEADER]: Becoming Leader. State: Replica: 32ae5d583ffa44e6bf0a3519ddbab830, State: Running, Role: LEADER
I20260812 06:59:38.895812 7765 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ae5d583ffa44e6bf0a3519ddbab830" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46051 } }
I20260812 06:59:38.896035 7759 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:59:38.898654 7766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32ae5d583ffa44e6bf0a3519ddbab830" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ae5d583ffa44e6bf0a3519ddbab830" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46051 } } }
I20260812 06:59:38.898685 7767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32ae5d583ffa44e6bf0a3519ddbab830. Latest consensus state: current_term: 1 leader_uuid: "32ae5d583ffa44e6bf0a3519ddbab830" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ae5d583ffa44e6bf0a3519ddbab830" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46051 } } }
I20260812 06:59:38.899111 7766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [sys.catalog]: This master's current role is: LEADER
I20260812 06:59:38.899122 7767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830 [sys.catalog]: This master's current role is: LEADER
I20260812 06:59:38.901129 7783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:59:38.906304 7783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:59:38.906980 7759 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 06:59:38.924472 7783 catalog_manager.cc:1347] Generated new cluster ID: f99191e6c1154ba1a46a76d5dc6156a6
I20260812 06:59:38.924621 7783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:59:38.971143 7783 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:59:38.973325 7783 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:59:38.991760 7783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830: Generated new TSK 0
I20260812 06:59:38.992831 7783 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 06:59:39.870564 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:60215/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46051
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:40565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:59:40 dist-test-slave-tc2s krb5kdc[6837](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786517980, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 06:59:40.342856 7839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:59:40.343554 7839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:59:40.343765 7839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:59:40.357832 7839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:59:40.358215 7839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:59:40.358464 7839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 06:59:40.376528 7839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:40565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.18.70.148:60215/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46051
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:59:40.378701 7839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:59:40.380287 7839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:59:40.407424 7852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:59:40.409003 7855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:59:40.410684 7857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:59:40.410967 7839 server_base.cc:1034] running on GCE node
I20260812 06:59:40.411921 7839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:59:40.415072 7839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:59:40.416401 7839 hybrid_clock.cc:648] HybridClock initialized: now 1786517980416227 us; error 97 us; skew 500 ppm
I20260812 06:59:40.417002 7839 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:59:40 dist-test-slave-tc2s krb5kdc[6837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517980, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:59:40.423923 7839 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 06:59:40.427567 7839 webserver.cc:460] Webserver started at http://127.18.70.129:41911/ using document root <none> and password file <none>
I20260812 06:59:40.428635 7839 fs_manager.cc:359] Metadata directory not provided
I20260812 06:59:40.428889 7839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:59:40.429445 7839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:59:40 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517980, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 06:59:40.451176 7839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "d4ccfb9f5dbd483cba2601936a32a607"
format_stamp: "Formatted at 2026-08-12 06:59:40 on dist-test-slave-tc2s"
server_key: "5624c1caa0b5d35924303f165f34966b"
server_key_iv: "bfd55adc9aa4f82bdcc2e4157ed65871"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:40.452345 7839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "d4ccfb9f5dbd483cba2601936a32a607"
format_stamp: "Formatted at 2026-08-12 06:59:40 on dist-test-slave-tc2s"
server_key: "5624c1caa0b5d35924303f165f34966b"
server_key_iv: "bfd55adc9aa4f82bdcc2e4157ed65871"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:40.470307 7839 fs_manager.cc:691] Time spent creating directory manager: real 0.017s user 0.014s sys 0.004s
I20260812 06:59:40.502444 7867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:59:40.505014 7839 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.001s
I20260812 06:59:40.505424 7839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "d4ccfb9f5dbd483cba2601936a32a607"
format_stamp: "Formatted at 2026-08-12 06:59:40 on dist-test-slave-tc2s"
server_key: "5624c1caa0b5d35924303f165f34966b"
server_key_iv: "bfd55adc9aa4f82bdcc2e4157ed65871"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:40.505942 7839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:59:40.546365 7839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:59:40.554297 7839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:59:40.554986 7839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:59:40.557222 7839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:59:40.560382 7839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:59:40.560534 7839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:59:40.560706 7839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:59:40.560847 7839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:59:40.663043 7839 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:44033
I20260812 06:59:40.663156 8094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:44033 every 8 connection(s)
I20260812 06:59:40.665033 7839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 06:59:40.670372 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 7839
I20260812 06:59:40.670605 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 06:59:40.671442 18714 external_mini_cluster.cc:1428] Setting key 7c0eebe08a9ff9730e1a153c751ebc41
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Aug 12 06:59:40 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517980, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
I20260812 06:59:40.780277 8099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:40.672722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:40133 (local address 127.18.70.190:46051)
0812 06:59:40.692612 (+ 19890us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:40.692619 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:40.726473 (+ 33854us) server_negotiation.cc:407] Connection header received
0812 06:59:40.738903 (+ 12430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:40.738911 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:40.739086 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:40.739194 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:59:40.743405 (+ 4211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:40.745046 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:40.749327 (+ 4281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:40.750430 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:40.750573 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:40.770933 (+ 20360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:59:40.770943 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:59:40.770949 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:59:40.771021 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:59:40.774493 (+ 3472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:40.776951 (+ 2458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:40.776958 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:40.776962 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:40.777164 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:40.777800 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:40.777806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:40.777809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:40.778232 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:59:40.778369 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:40.779479 (+ 1110us) server_negotiation.cc:299] Negotiation successful
0812 06:59:40.779742 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19722,"thread_start_us":19901,"threads_started":1}
I20260812 06:59:40.783430 8097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:40.669451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46051 (local address 127.18.70.129:40133)
0812 06:59:40.723846 (+ 54395us) negotiation.cc:107] Waiting for socket to connect
0812 06:59:40.723929 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0812 06:59:40.737677 (+ 13748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:59:40.739992 (+ 2315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:59:40.740007 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:59:40.741201 (+ 1194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:59:40.743071 (+ 1870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:40.743157 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:40.745346 (+ 2189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:40.745351 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:40.749081 (+ 3730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:40.749103 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:40.751170 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:40.751180 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:40.751643 (+ 463us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:40.752774 (+ 1131us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:59:40.752809 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:59:40.760219 (+ 7410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:59:40.774736 (+ 14517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:59:40.774748 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:59:40.774773 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:59:40.775462 (+ 689us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:59:40.777327 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:59:40.777332 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:59:40.777335 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:59:40.777654 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:59:40.778476 (+ 822us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:59:40.778485 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:59:40.779003 (+ 518us) client_negotiation.cc:769] Sending connection context
0812 06:59:40.780681 (+ 1678us) client_negotiation.cc:240] Negotiation successful
0812 06:59:40.781467 (+ 786us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53938,"thread_start_us":61107,"threads_started":1}
I20260812 06:59:40.786128 8095 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46051
I20260812 06:59:40.786557 8095 heartbeater.cc:464] Registering TS with master...
I20260812 06:59:40.787983 8095 heartbeater.cc:511] Master 127.18.70.190:46051 requested a full tablet report, sending...
I20260812 06:59:40.791567 7700 ts_manager.cc:194] Registered new tserver with Master: d4ccfb9f5dbd483cba2601936a32a607 (127.18.70.129:44033)
I20260812 06:59:40.794348 7700 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:40133
Aug 12 06:59:40 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517980, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
W20260812 06:59:40.843025 18714 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.18.70.130: real 0.148s user 0.000s sys 0.026s
I20260812 06:59:40.844169 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:60215/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46051
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:40565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:59:41 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517980, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 06:59:41.799777 8095 heartbeater.cc:503] Master 127.18.70.190:46051 was elected leader, sending a full tablet report...
W20260812 06:59:41.835799 8104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:59:41.836202 8104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:59:41.836928 8104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:59:41.849720 8104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:59:41.850010 8104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:59:41.850271 8104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 06:59:41.869148 8104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:40565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.18.70.148:60215/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46051
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:59:41.870962 8104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:59:41.872455 8104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:59:41.897027 8126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:59:41.898952 8130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:59:41.900375 8125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:59:41.904227 8104 server_base.cc:1034] running on GCE node
I20260812 06:59:41.905120 8104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:59:41.906558 8104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:59:41.907915 8104 hybrid_clock.cc:648] HybridClock initialized: now 1786517981907733 us; error 100 us; skew 500 ppm
I20260812 06:59:41.908447 8104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:59:41 dist-test-slave-tc2s krb5kdc[6837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517981, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:59:41.914253 8104 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 06:59:41.917407 8104 webserver.cc:460] Webserver started at http://127.18.70.130:41059/ using document root <none> and password file <none>
I20260812 06:59:41.918921 8104 fs_manager.cc:359] Metadata directory not provided
I20260812 06:59:41.919275 8104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:59:41.919816 8104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:59:41 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517981, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 06:59:41.940816 8104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "0b584106c28f4696a813051900050e7c"
format_stamp: "Formatted at 2026-08-12 06:59:41 on dist-test-slave-tc2s"
server_key: "c340d0037c34f5e89a1669c48c33cf8b"
server_key_iv: "b025bfbc7bdc8e48809b4c91880a18da"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:41.942718 8104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "0b584106c28f4696a813051900050e7c"
format_stamp: "Formatted at 2026-08-12 06:59:41 on dist-test-slave-tc2s"
server_key: "c340d0037c34f5e89a1669c48c33cf8b"
server_key_iv: "b025bfbc7bdc8e48809b4c91880a18da"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:41.954229 8104 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.006s sys 0.004s
I20260812 06:59:41.977445 8148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:59:41.979285 8104 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.002s
I20260812 06:59:41.979538 8104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "0b584106c28f4696a813051900050e7c"
format_stamp: "Formatted at 2026-08-12 06:59:41 on dist-test-slave-tc2s"
server_key: "c340d0037c34f5e89a1669c48c33cf8b"
server_key_iv: "b025bfbc7bdc8e48809b4c91880a18da"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:41.979910 8104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:59:42.014096 8104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:59:42.020315 8104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:59:42.020985 8104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:59:42.023211 8104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:59:42.026244 8104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:59:42.026412 8104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:59:42.026687 8104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:59:42.026837 8104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:59:42.227114 8104 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:39035
I20260812 06:59:42.227200 8331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:39035 every 8 connection(s)
I20260812 06:59:42.229596 8104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 06:59:42.231753 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 8104
I20260812 06:59:42.232016 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 06:59:42.232852 18714 external_mini_cluster.cc:1428] Setting key e96afa29561edfc2b03c43eea619e5a1
Aug 12 06:59:42 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517981, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:59:42.313211 8335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:42.256549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:46265 (local address 127.18.70.190:46051)
0812 06:59:42.275118 (+ 18569us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:42.275127 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:42.277127 (+ 2000us) server_negotiation.cc:407] Connection header received
0812 06:59:42.281472 (+ 4345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:42.281478 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:42.281590 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:42.281854 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:59:42.285167 (+ 3313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:42.286258 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:42.292149 (+ 5891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:42.293119 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:42.293287 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:42.301480 (+ 8193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:59:42.301486 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:59:42.301490 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:59:42.301533 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:59:42.307266 (+ 5733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:42.308682 (+ 1416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:42.308690 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:42.308693 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:42.309000 (+ 307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:42.309931 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:42.309936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:42.309939 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:42.310472 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:59:42.310613 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:42.311897 (+ 1284us) server_negotiation.cc:299] Negotiation successful
0812 06:59:42.312274 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18344,"thread_start_us":18035,"threads_started":1}
I20260812 06:59:42.317512 8334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:42.255261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46051 (local address 127.18.70.130:46265)
0812 06:59:42.276679 (+ 21418us) negotiation.cc:107] Waiting for socket to connect
0812 06:59:42.276746 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 06:59:42.280964 (+ 4218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:59:42.282270 (+ 1306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:59:42.282286 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:59:42.283439 (+ 1153us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:59:42.284947 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:42.284981 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:42.288475 (+ 3494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:42.288481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:42.291894 (+ 3413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:42.291917 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:42.293989 (+ 2072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:42.293999 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:42.294391 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:42.295986 (+ 1595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:59:42.296067 (+ 81us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:59:42.301138 (+ 5071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:59:42.307564 (+ 6426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:59:42.307578 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:59:42.307603 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:59:42.308494 (+ 891us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:59:42.309221 (+ 727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:59:42.309226 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:59:42.309229 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:59:42.309755 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:59:42.310719 (+ 964us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:59:42.310728 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:59:42.311321 (+ 593us) client_negotiation.cc:769] Sending connection context
0812 06:59:42.314307 (+ 2986us) client_negotiation.cc:240] Negotiation successful
0812 06:59:42.315326 (+ 1019us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20886,"thread_start_us":20228,"threads_started":1}
I20260812 06:59:42.320691 8332 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46051
I20260812 06:59:42.321233 8332 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
I20260812 06:59:42.322873 8332 heartbeater.cc:511] Master 127.18.70.190:46051 requested a full tablet report, sending...
I20260812 06:59:42.324858 7700 ts_manager.cc:194] Registered new tserver with Master: 0b584106c28f4696a813051900050e7c (127.18.70.130:39035)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
I20260812 06:59:42.325851 7700 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:46265
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
W20260812 06:59:42.373188 18714 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.18.70.131: real 0.136s user 0.001s sys 0.052s
I20260812 06:59:42.374063 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:60215/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46051
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:40565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:59:43.151633 8341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:59:43.151953 8341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:59:43.152097 8341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:59:43.160602 8341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:59:43.160751 8341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:59:43.160912 8341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 06:59:43.173699 8341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:40565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.18.70.148:60215/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46051
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 06:59:43.175671 8341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:59:43.177317 8341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:59:43.199874 8350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:59:43.199785 8354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:59:43.199903 8359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:59:43.201838 8341 server_base.cc:1034] running on GCE node
I20260812 06:59:43.203058 8341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:59:43.204700 8341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:59:43.206130 8341 hybrid_clock.cc:648] HybridClock initialized: now 1786517983205953 us; error 82 us; skew 500 ppm
I20260812 06:59:43.206727 8341 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 06:59:43 dist-test-slave-tc2s krb5kdc[6837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517983, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:59:43.212600 8341 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 06:59:43.215684 8341 webserver.cc:460] Webserver started at http://127.18.70.131:42589/ using document root <none> and password file <none>
I20260812 06:59:43.216780 8341 fs_manager.cc:359] Metadata directory not provided
I20260812 06:59:43.217042 8341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:59:43.217571 8341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:59:43 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517983, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 06:59:43.241071 8341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "f0df21b7c1574689a06a76759e9cbe53"
format_stamp: "Formatted at 2026-08-12 06:59:43 on dist-test-slave-tc2s"
server_key: "ac977726e94c8772e0682a2fe7f9d9cd"
server_key_iv: "7426dc107b6002ac171673acb3053aea"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:43.242569 8341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "f0df21b7c1574689a06a76759e9cbe53"
format_stamp: "Formatted at 2026-08-12 06:59:43 on dist-test-slave-tc2s"
server_key: "ac977726e94c8772e0682a2fe7f9d9cd"
server_key_iv: "7426dc107b6002ac171673acb3053aea"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:43.251857 8341 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.002s
I20260812 06:59:43.274261 8366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:59:43.276410 8341 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.002s
I20260812 06:59:43.276726 8341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "f0df21b7c1574689a06a76759e9cbe53"
format_stamp: "Formatted at 2026-08-12 06:59:43 on dist-test-slave-tc2s"
server_key: "ac977726e94c8772e0682a2fe7f9d9cd"
server_key_iv: "7426dc107b6002ac171673acb3053aea"
server_key_version: "kuduclusterkey@0"
I20260812 06:59:43.277086 8341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:59:43.329965 8332 heartbeater.cc:503] Master 127.18.70.190:46051 was elected leader, sending a full tablet report...
I20260812 06:59:43.330586 8341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:59:43.338272 8341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:59:43.338866 8341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:59:43.340878 8341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:59:43.343307 8341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:59:43.343482 8341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:59:43.343685 8341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:59:43.343806 8341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:59:43.455709 8341 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:37577
I20260812 06:59:43.455731 8551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:37577 every 8 connection(s)
I20260812 06:59:43.457623 8341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 06:59:43.464737 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 8341
I20260812 06:59:43.464941 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 06:59:43.465574 18714 external_mini_cluster.cc:1428] Setting key 86bd5d0cc366ad58ca420005cdd3f3e7
Aug 12 06:59:43 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517983, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 06:59:43.497437 8560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.462454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:52477 (local address 127.18.70.190:46051)
0812 06:59:43.463427 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:43.463432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:43.465752 (+ 2320us) server_negotiation.cc:407] Connection header received
0812 06:59:43.469641 (+ 3889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:43.469646 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:43.469724 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:43.470088 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:59:43.473100 (+ 3012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.474687 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.477188 (+ 2501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.478038 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.478145 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.484324 (+ 6179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:59:43.484333 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:59:43.484339 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:59:43.484431 (+ 92us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:59:43.492858 (+ 8427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:43.494027 (+ 1169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:43.494032 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:43.494034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:43.494253 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:43.494958 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:43.494963 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:43.494966 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:43.495539 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:59:43.495650 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:43.496641 (+ 991us) server_negotiation.cc:299] Negotiation successful
0812 06:59:43.496945 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":845,"thread_start_us":663,"threads_started":1}
I20260812 06:59:43.498608 8562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.463560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46051 (local address 127.18.70.131:52477)
0812 06:59:43.465342 (+ 1782us) negotiation.cc:107] Waiting for socket to connect
0812 06:59:43.465397 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 06:59:43.469253 (+ 3856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:59:43.470632 (+ 1379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:59:43.470646 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:59:43.471604 (+ 958us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:59:43.472794 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.472820 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.474994 (+ 2174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.474999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.477036 (+ 2037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.477054 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.478418 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.478427 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.478784 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.479809 (+ 1025us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:59:43.479841 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:59:43.483944 (+ 4103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:59:43.493083 (+ 9139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:59:43.493093 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:59:43.493111 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:59:43.493918 (+ 807us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:59:43.494383 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:59:43.494386 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:59:43.494389 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:59:43.494821 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:59:43.495696 (+ 875us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:59:43.495706 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:59:43.496102 (+ 396us) client_negotiation.cc:769] Sending connection context
0812 06:59:43.496474 (+ 372us) client_negotiation.cc:240] Negotiation successful
0812 06:59:43.497083 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1362,"thread_start_us":1017,"threads_started":1}
I20260812 06:59:43.500957 8553 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46051
I20260812 06:59:43.501554 8553 heartbeater.cc:464] Registering TS with master...
I20260812 06:59:43.502765 8553 heartbeater.cc:511] Master 127.18.70.190:46051 requested a full tablet report, sending...
I20260812 06:59:43.505475 7700 ts_manager.cc:194] Registered new tserver with Master: f0df21b7c1574689a06a76759e9cbe53 (127.18.70.131:37577)
I20260812 06:59:43.507151 7700 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:52477
I20260812 06:59:43.508520 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:59:43.535727 8560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.516134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40726 (local address 127.18.70.190:46051)
0812 06:59:43.516372 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:43.516379 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:43.517262 (+ 883us) server_negotiation.cc:407] Connection header received
0812 06:59:43.517417 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:43.517422 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:43.517565 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:43.517678 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:59:43.520271 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.521549 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.523776 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.524493 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.524605 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.527922 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:59:43.527927 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:59:43.527932 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:59:43.527967 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:59:43.531921 (+ 3954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:43.532890 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:43.532894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:43.532896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:43.533099 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:43.533484 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:43.533487 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:43.533489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:43.533866 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:59:43.534197 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:43.534764 (+ 567us) server_negotiation.cc:299] Negotiation successful
0812 06:59:43.535098 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 06:59:43.541606 7700 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40726:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:59:43.555308 7700 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:59:43.597321 8583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.575868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44033 (local address 127.0.0.1:49366)
0812 06:59:43.579991 (+ 4123us) negotiation.cc:107] Waiting for socket to connect
0812 06:59:43.580033 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:59:43.580421 (+ 388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:59:43.582230 (+ 1809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:59:43.582239 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:59:43.582278 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:59:43.583446 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.583464 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.586897 (+ 3433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.586904 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.591282 (+ 4378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.591302 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.595817 (+ 4515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.595827 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.596119 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.596174 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 06:59:43.596315 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 06:59:43.596559 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3721,"spinlock_wait_cycles":4992,"thread_start_us":3679,"threads_started":1}
I20260812 06:59:43.597347 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.576511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49366 (local address 127.18.70.129:44033)
0812 06:59:43.578802 (+ 2291us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:43.578813 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:43.580685 (+ 1872us) server_negotiation.cc:407] Connection header received
0812 06:59:43.580809 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:43.580817 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:43.581253 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:43.581684 (+ 431us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:59:43.583826 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.586677 (+ 2851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.592732 (+ 6055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.594806 (+ 2074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.595000 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.595423 (+ 423us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:43.596396 (+ 973us) server_negotiation.cc:299] Negotiation successful
0812 06:59:43.596686 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1142,"thread_start_us":1251,"threads_started":1}
I20260812 06:59:43.603555 8585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.575867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:39035 (local address 127.0.0.1:46318)
0812 06:59:43.580164 (+ 4297us) negotiation.cc:107] Waiting for socket to connect
0812 06:59:43.580184 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:59:43.580484 (+ 300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:59:43.583205 (+ 2721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:59:43.583211 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:59:43.583239 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:59:43.593639 (+ 10400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.593655 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.596561 (+ 2906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.596566 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.599747 (+ 3181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.599760 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.602516 (+ 2756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.602524 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.602822 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.602858 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:59:43.602954 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 06:59:43.603116 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4090,"mutex_wait_us":54,"thread_start_us":3140,"threads_started":1}
I20260812 06:59:43.603998 8580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.576369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46318 (local address 127.18.70.130:39035)
0812 06:59:43.577700 (+ 1331us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:43.577711 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:43.580686 (+ 2975us) server_negotiation.cc:407] Connection header received
0812 06:59:43.580799 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:43.580807 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:43.581132 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:43.581665 (+ 533us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:59:43.593884 (+ 12219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.596308 (+ 2424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.599913 (+ 3605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.602090 (+ 2177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.602271 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.602614 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:43.603043 (+ 429us) server_negotiation.cc:299] Negotiation successful
0812 06:59:43.603302 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1092,"thread_start_us":722,"threads_started":1}
I20260812 06:59:43.603962 7967 tablet_service.cc:1467] Processing CreateTablet for tablet 9e00cc8fa57747a99f9c79e843210821 (DEFAULT_TABLE table=test-table [id=55b7a6f128bf40fc82180bbbab768d3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:59:43.606187 8587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.580231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:37577 (local address 127.0.0.1:34776)
0812 06:59:43.593418 (+ 13187us) negotiation.cc:107] Waiting for socket to connect
0812 06:59:43.593441 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 06:59:43.593809 (+ 368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:59:43.594863 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:59:43.594868 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:59:43.594896 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:59:43.595989 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.596002 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.599704 (+ 3702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.599711 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.602501 (+ 2790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.602524 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.605094 (+ 2570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.605101 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.605371 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.605399 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 06:59:43.605486 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 06:59:43.605607 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12966,"thread_start_us":12678,"threads_started":1}
I20260812 06:59:43.607355 8588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.580730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34776 (local address 127.18.70.131:37577)
0812 06:59:43.588081 (+ 7351us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:43.588088 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:43.593949 (+ 5861us) server_negotiation.cc:407] Connection header received
0812 06:59:43.594071 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:43.594081 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:43.594431 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:43.594856 (+ 425us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:59:43.596333 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.599537 (+ 3204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.602748 (+ 3211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.604762 (+ 2014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.604885 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.605283 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:43.606470 (+ 1187us) server_negotiation.cc:299] Negotiation successful
0812 06:59:43.606730 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7120,"thread_start_us":6670,"threads_started":1}
I20260812 06:59:43.607642 7967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e00cc8fa57747a99f9c79e843210821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:59:43.609880 8219 tablet_service.cc:1467] Processing CreateTablet for tablet 9e00cc8fa57747a99f9c79e843210821 (DEFAULT_TABLE table=test-table [id=55b7a6f128bf40fc82180bbbab768d3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:59:43.611928 8219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e00cc8fa57747a99f9c79e843210821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:59:43.613237 8441 tablet_service.cc:1467] Processing CreateTablet for tablet 9e00cc8fa57747a99f9c79e843210821 (DEFAULT_TABLE table=test-table [id=55b7a6f128bf40fc82180bbbab768d3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:59:43.615731 8441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e00cc8fa57747a99f9c79e843210821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:59:43.629122 8592 tablet_bootstrap.cc:492] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: Bootstrap starting.
I20260812 06:59:43.633742 8593 tablet_bootstrap.cc:492] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: Bootstrap starting.
I20260812 06:59:43.636431 8592 tablet_bootstrap.cc:654] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: Neither blocks nor log segments found. Creating new log.
I20260812 06:59:43.639137 8592 log.cc:824] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:59:43.640597 8594 tablet_bootstrap.cc:492] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: Bootstrap starting.
I20260812 06:59:43.641072 8593 tablet_bootstrap.cc:654] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: Neither blocks nor log segments found. Creating new log.
I20260812 06:59:43.644022 8593 log.cc:824] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: Log is configured to *not* fsync() on all Append() calls
I20260812 06:59:43.647390 8594 tablet_bootstrap.cc:654] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: Neither blocks nor log segments found. Creating new log.
I20260812 06:59:43.648353 8592 tablet_bootstrap.cc:492] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: No bootstrap required, opened a new log
I20260812 06:59:43.648739 8592 ts_tablet_manager.cc:1397] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.000s
I20260812 06:59:43.649209 8593 tablet_bootstrap.cc:492] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: No bootstrap required, opened a new log
I20260812 06:59:43.649609 8593 ts_tablet_manager.cc:1397] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.009s
I20260812 06:59:43.650061 8594 log.cc:824] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: Log is configured to *not* fsync() on all Append() calls
I20260812 06:59:43.655184 8594 tablet_bootstrap.cc:492] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: No bootstrap required, opened a new log
I20260812 06:59:43.655570 8594 ts_tablet_manager.cc:1397] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260812 06:59:43.662776 8592 raft_consensus.cc:348] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.663489 8592 raft_consensus.cc:374] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:59:43.663686 8592 raft_consensus.cc:729] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b584106c28f4696a813051900050e7c, State: Initialized, Role: FOLLOWER
I20260812 06:59:43.664801 8592 consensus_queue.cc:260] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.666750 8593 raft_consensus.cc:348] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.667452 8593 raft_consensus.cc:374] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:59:43.667594 8593 raft_consensus.cc:729] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4ccfb9f5dbd483cba2601936a32a607, State: Initialized, Role: FOLLOWER
I20260812 06:59:43.668427 8593 consensus_queue.cc:260] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.674995 8594 raft_consensus.cc:348] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.675766 8594 raft_consensus.cc:374] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:59:43.675909 8594 raft_consensus.cc:729] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0df21b7c1574689a06a76759e9cbe53, State: Initialized, Role: FOLLOWER
I20260812 06:59:43.676819 8594 consensus_queue.cc:260] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.680171 8593 ts_tablet_manager.cc:1428] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: Time spent starting tablet: real 0.030s user 0.020s sys 0.011s
I20260812 06:59:43.683204 8592 ts_tablet_manager.cc:1428] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: Time spent starting tablet: real 0.034s user 0.014s sys 0.022s
I20260812 06:59:43.685300 8553 heartbeater.cc:503] Master 127.18.70.190:46051 was elected leader, sending a full tablet report...
I20260812 06:59:43.686476 8594 ts_tablet_manager.cc:1428] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: Time spent starting tablet: real 0.031s user 0.019s sys 0.008s
W20260812 06:59:43.711440 8557 tablet.cc:2369] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:59:43.741565 8096 tablet.cc:2369] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:59:43.759594 8333 tablet.cc:2369] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:59:43.925222 8603 raft_consensus.cc:482] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:59:43.925752 8603 raft_consensus.cc:504] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.928236 8603 leader_election.cc:288] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b584106c28f4696a813051900050e7c (127.18.70.130:39035), d4ccfb9f5dbd483cba2601936a32a607 (127.18.70.129:44033)
I20260812 06:59:43.929222 8599 raft_consensus.cc:482] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:59:43.929636 8599 raft_consensus.cc:504] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.932508 8599 leader_election.cc:288] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4ccfb9f5dbd483cba2601936a32a607 (127.18.70.129:44033), f0df21b7c1574689a06a76759e9cbe53 (127.18.70.131:37577)
I20260812 06:59:43.940368 8580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.928663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:41303 (local address 127.18.70.130:39035)
0812 06:59:43.929077 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:43.929084 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:43.929605 (+ 521us) server_negotiation.cc:407] Connection header received
0812 06:59:43.929690 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:43.929695 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:43.929782 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:43.929886 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:59:43.931000 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.932821 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.936395 (+ 3574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.938499 (+ 2104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.938727 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.938807 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:43.939665 (+ 858us) server_negotiation.cc:299] Negotiation successful
0812 06:59:43.939886 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182}
I20260812 06:59:43.941009 8562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.929081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:39035 (local address 127.18.70.131:41303)
0812 06:59:43.929283 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 06:59:43.929308 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 06:59:43.929471 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:59:43.930150 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:59:43.930155 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:59:43.930182 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:59:43.930817 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.930833 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.933054 (+ 2221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.933059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.936051 (+ 2992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.936069 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.938938 (+ 2869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.938945 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.939373 (+ 428us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.939440 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 06:59:43.940533 (+ 1093us) client_negotiation.cc:240] Negotiation successful
0812 06:59:43.940669 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 06:59:43.943126 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.929418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:44259 (local address 127.18.70.129:44033)
0812 06:59:43.929761 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:43.929820 (+ 59us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:43.931549 (+ 1729us) server_negotiation.cc:407] Connection header received
0812 06:59:43.931788 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:43.931792 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:43.931850 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:43.931923 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:59:43.933354 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.934760 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.939924 (+ 5164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.941810 (+ 1886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.942026 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.942109 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:43.942588 (+ 479us) server_negotiation.cc:299] Negotiation successful
0812 06:59:43.942735 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":191}
I20260812 06:59:43.942664 8253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e00cc8fa57747a99f9c79e843210821" candidate_uuid: "f0df21b7c1574689a06a76759e9cbe53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b584106c28f4696a813051900050e7c" is_pre_election: true
I20260812 06:59:43.943697 8253 raft_consensus.cc:2454] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0df21b7c1574689a06a76759e9cbe53 in term 0.
I20260812 06:59:43.944509 8604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.929520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44033 (local address 127.18.70.131:44259)
0812 06:59:43.931254 (+ 1734us) negotiation.cc:107] Waiting for socket to connect
0812 06:59:43.931269 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:59:43.931650 (+ 381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:59:43.931953 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:59:43.931958 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:59:43.931981 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:59:43.933086 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.933104 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.935129 (+ 2025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.935136 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.939689 (+ 4553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.939704 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.942119 (+ 2415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.942127 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.942359 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.942395 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:59:43.943526 (+ 1131us) client_negotiation.cc:240] Negotiation successful
0812 06:59:43.943675 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1582,"thread_start_us":1400,"threads_started":1}
I20260812 06:59:43.944999 8370 leader_election.cc:302] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b584106c28f4696a813051900050e7c, f0df21b7c1574689a06a76759e9cbe53; no voters:
I20260812 06:59:43.946477 8005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e00cc8fa57747a99f9c79e843210821" candidate_uuid: "f0df21b7c1574689a06a76759e9cbe53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ccfb9f5dbd483cba2601936a32a607" is_pre_election: true
I20260812 06:59:43.947371 8603 raft_consensus.cc:2781] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:59:43.947320 8005 raft_consensus.cc:2454] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0df21b7c1574689a06a76759e9cbe53 in term 0.
I20260812 06:59:43.947678 8603 raft_consensus.cc:482] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:59:43.947870 8603 raft_consensus.cc:3037] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:59:43.951620 8606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.933278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44033 (local address 127.18.70.130:39923)
0812 06:59:43.938660 (+ 5382us) negotiation.cc:107] Waiting for socket to connect
0812 06:59:43.938678 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:59:43.939165 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:59:43.940224 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:59:43.940229 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:59:43.940258 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:59:43.941628 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.941643 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.944551 (+ 2908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.944556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.948049 (+ 3493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.948065 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.950479 (+ 2414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.950487 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.950662 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.950698 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:59:43.950802 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 06:59:43.950942 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5209,"thread_start_us":4829,"threads_started":1}
I20260812 06:59:43.952323 8605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.932812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:39923 (local address 127.18.70.129:44033)
0812 06:59:43.937789 (+ 4977us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:43.937794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:43.939116 (+ 1322us) server_negotiation.cc:407] Connection header received
0812 06:59:43.939307 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:43.939312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:43.939381 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:43.939693 (+ 312us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:59:43.941931 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.944360 (+ 2429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.948229 (+ 3869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.950059 (+ 1830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.950232 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.950306 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:43.951521 (+ 1215us) server_negotiation.cc:299] Negotiation successful
0812 06:59:43.951693 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4786,"thread_start_us":4313,"threads_started":1}
I20260812 06:59:43.953281 8603 raft_consensus.cc:504] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.953462 8005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e00cc8fa57747a99f9c79e843210821" candidate_uuid: "0b584106c28f4696a813051900050e7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ccfb9f5dbd483cba2601936a32a607" is_pre_election: true
I20260812 06:59:43.953775 8005 raft_consensus.cc:2454] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b584106c28f4696a813051900050e7c in term 0.
I20260812 06:59:43.954372 8603 leader_election.cc:288] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [CANDIDATE]: Term 1 election: Requested vote from peers 0b584106c28f4696a813051900050e7c (127.18.70.130:39035), d4ccfb9f5dbd483cba2601936a32a607 (127.18.70.129:44033)
I20260812 06:59:43.954449 8149 leader_election.cc:302] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b584106c28f4696a813051900050e7c, d4ccfb9f5dbd483cba2601936a32a607; no voters:
I20260812 06:59:43.954952 8253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e00cc8fa57747a99f9c79e843210821" candidate_uuid: "f0df21b7c1574689a06a76759e9cbe53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b584106c28f4696a813051900050e7c"
I20260812 06:59:43.955057 8599 raft_consensus.cc:2781] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:59:43.955313 8253 raft_consensus.cc:3037] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:59:43.955333 8005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e00cc8fa57747a99f9c79e843210821" candidate_uuid: "f0df21b7c1574689a06a76759e9cbe53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ccfb9f5dbd483cba2601936a32a607"
I20260812 06:59:43.955615 8588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.939049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:52255 (local address 127.18.70.131:37577)
0812 06:59:43.940266 (+ 1217us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:43.940272 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:43.943635 (+ 3363us) server_negotiation.cc:407] Connection header received
0812 06:59:43.943942 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:43.943948 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:43.944039 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:43.944104 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:59:43.947078 (+ 2974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.948723 (+ 1645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.951513 (+ 2790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.953519 (+ 2006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.953737 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.953951 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:43.955110 (+ 1159us) server_negotiation.cc:299] Negotiation successful
0812 06:59:43.955246 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1061}
I20260812 06:59:43.955651 8005 raft_consensus.cc:3037] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:59:43.956395 8607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:43.940419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:37577 (local address 127.18.70.130:52255)
0812 06:59:43.943364 (+ 2945us) negotiation.cc:107] Waiting for socket to connect
0812 06:59:43.943384 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:59:43.943766 (+ 382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:59:43.944571 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:59:43.944575 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:59:43.944604 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:59:43.946816 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.946833 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.948872 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.948877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.951324 (+ 2447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:59:43.951337 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:59:43.954606 (+ 3269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:59:43.954617 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:59:43.954907 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:43.954941 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 06:59:43.955645 (+ 704us) client_negotiation.cc:240] Negotiation successful
0812 06:59:43.955932 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2617,"thread_start_us":4204,"threads_started":1}
I20260812 06:59:43.957654 8474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e00cc8fa57747a99f9c79e843210821" candidate_uuid: "0b584106c28f4696a813051900050e7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0df21b7c1574689a06a76759e9cbe53" is_pre_election: true
I20260812 06:59:43.958482 8474 raft_consensus.cc:2379] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b584106c28f4696a813051900050e7c in current term 1: Already voted for candidate f0df21b7c1574689a06a76759e9cbe53 in this term.
I20260812 06:59:43.960570 8253 raft_consensus.cc:2454] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0df21b7c1574689a06a76759e9cbe53 in term 1.
I20260812 06:59:43.960958 8005 raft_consensus.cc:2454] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0df21b7c1574689a06a76759e9cbe53 in term 1.
I20260812 06:59:43.960965 8599 raft_consensus.cc:482] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:59:43.961166 8599 raft_consensus.cc:3037] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:59:43.961184 8370 leader_election.cc:302] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b584106c28f4696a813051900050e7c, f0df21b7c1574689a06a76759e9cbe53; no voters:
I20260812 06:59:43.961632 8603 raft_consensus.cc:2781] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:59:43.962827 8603 raft_consensus.cc:686] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 1 LEADER]: Becoming Leader. State: Replica: f0df21b7c1574689a06a76759e9cbe53, State: Running, Role: LEADER
I20260812 06:59:43.963631 8603 consensus_queue.cc:237] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.965274 8599 raft_consensus.cc:504] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.967358 8599 leader_election.cc:288] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [CANDIDATE]: Term 2 election: Requested vote from peers d4ccfb9f5dbd483cba2601936a32a607 (127.18.70.129:44033), f0df21b7c1574689a06a76759e9cbe53 (127.18.70.131:37577)
I20260812 06:59:43.967859 8005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e00cc8fa57747a99f9c79e843210821" candidate_uuid: "0b584106c28f4696a813051900050e7c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4ccfb9f5dbd483cba2601936a32a607"
I20260812 06:59:43.968423 8474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e00cc8fa57747a99f9c79e843210821" candidate_uuid: "0b584106c28f4696a813051900050e7c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0df21b7c1574689a06a76759e9cbe53"
I20260812 06:59:43.968664 8005 raft_consensus.cc:3037] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:59:43.970305 7693 catalog_manager.cc:5495] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0df21b7c1574689a06a76759e9cbe53 (127.18.70.131). New cstate: current_term: 1 leader_uuid: "f0df21b7c1574689a06a76759e9cbe53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } health_report { overall_health: HEALTHY } } }
I20260812 06:59:43.972864 8005 raft_consensus.cc:2454] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b584106c28f4696a813051900050e7c in term 2.
I20260812 06:59:43.973848 8149 leader_election.cc:302] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b584106c28f4696a813051900050e7c, d4ccfb9f5dbd483cba2601936a32a607; no voters: f0df21b7c1574689a06a76759e9cbe53
I20260812 06:59:43.974493 8599 raft_consensus.cc:2781] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:59:43.976074 8599 raft_consensus.cc:686] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 2 LEADER]: Becoming Leader. State: Replica: 0b584106c28f4696a813051900050e7c, State: Running, Role: LEADER
I20260812 06:59:43.976926 8599 consensus_queue.cc:237] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:43.983956 7693 catalog_manager.cc:5495] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c reported cstate change: term changed from 1 to 2, leader changed from f0df21b7c1574689a06a76759e9cbe53 (127.18.70.131) to 0b584106c28f4696a813051900050e7c (127.18.70.130). New cstate: current_term: 2 leader_uuid: "0b584106c28f4696a813051900050e7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } health_report { overall_health: UNKNOWN } } }
I20260812 06:59:44.056743 8580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:44.046282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46332 (local address 127.18.70.130:39035)
0812 06:59:44.046600 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:44.046606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:44.048093 (+ 1487us) server_negotiation.cc:407] Connection header received
0812 06:59:44.048284 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:44.048288 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:44.048389 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:44.048668 (+ 279us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:59:44.049427 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:44.050895 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:44.053155 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:44.054068 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:44.054196 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:44.055059 (+ 863us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:59:44.055908 (+ 849us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:59:44.056064 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:44.056298 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 06:59:44.056413 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260812 06:59:44.069244 8474 raft_consensus.cc:3032] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 06:59:44.069530 8474 raft_consensus.cc:729] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0df21b7c1574689a06a76759e9cbe53, State: Running, Role: LEADER
I20260812 06:59:44.069754 8005 raft_consensus.cc:1261] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 2 FOLLOWER]: Refusing update from remote peer 0b584106c28f4696a813051900050e7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 06:59:44.070045 8474 consensus_queue.cc:260] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b584106c28f4696a813051900050e7c" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39035 } } peers { permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 } } peers { permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 } }
I20260812 06:59:44.070708 8474 raft_consensus.cc:3037] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:59:44.071174 8599 consensus_queue.cc:1035] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4ccfb9f5dbd483cba2601936a32a607" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:59:44.074378 8474 raft_consensus.cc:1261] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 2 FOLLOWER]: Refusing update from remote peer 0b584106c28f4696a813051900050e7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 06:59:44.075456 8599 consensus_queue.cc:1035] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0df21b7c1574689a06a76759e9cbe53" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:59:44.075687 8599 consensus_queue.cc:1225] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [LEADER]: Peer f0df21b7c1574689a06a76759e9cbe53 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260812 06:59:44.077934 8474 pending_rounds.cc:76] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: Aborting all ops after (but not including) 0
I20260812 06:59:44.078080 8474 pending_rounds.cc:97] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260812 06:59:44.078287 8474 raft_consensus.cc:2866] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 06:59:44.090001 8627 mvcc.cc:205] Tried to move back new op lower bound from 7317577662731616256 to 7317577662374854656. Current Snapshot: MvccSnapshot[applied={T|T < 7317577662731616256}]
I20260812 06:59:44.106251 7693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:59:44.106555 7693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:59:44.111016 7693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32ae5d583ffa44e6bf0a3519ddbab830: Sending DeleteTablet for 3 replicas of tablet 9e00cc8fa57747a99f9c79e843210821
I20260812 06:59:44.112591 7967 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e00cc8fa57747a99f9c79e843210821 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:59:44 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:49366
I20260812 06:59:44.112612 8219 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e00cc8fa57747a99f9c79e843210821 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:59:44 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:46318
I20260812 06:59:44.113549 8441 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e00cc8fa57747a99f9c79e843210821 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:59:44 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:34776
I20260812 06:59:44.114876 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 7839
I20260812 06:59:44.122675 8640 tablet_replica.cc:330] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: stopping tablet replica
I20260812 06:59:44.123386 8640 raft_consensus.cc:2229] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 06:59:44.124332 8640 raft_consensus.cc:2258] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 06:59:44.124989 8641 tablet_replica.cc:330] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: stopping tablet replica
I20260812 06:59:44.125685 8641 raft_consensus.cc:2229] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 06:59:44.126554 8641 raft_consensus.cc:2258] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 06:59:44.127348 8635 tablet_replica.cc:330] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: stopping tablet replica
I20260812 06:59:44.128158 8635 raft_consensus.cc:2229] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 2 LEADER]: Raft consensus shutting down.
I20260812 06:59:44.130442 8641 ts_tablet_manager.cc:1905] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:59:44.130990 8640 ts_tablet_manager.cc:1905] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:59:44.136936 8635 raft_consensus.cc:2258] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 06:59:44.138881 8641 ts_tablet_manager.cc:1918] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260812 06:59:44.139081 8641 log.cc:1196] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/9e00cc8fa57747a99f9c79e843210821
I20260812 06:59:44.139632 8641 ts_tablet_manager.cc:1939] T 9e00cc8fa57747a99f9c79e843210821 P f0df21b7c1574689a06a76759e9cbe53: Deleting consensus metadata
I20260812 06:59:44.141758 7670 catalog_manager.cc:4841] TS f0df21b7c1574689a06a76759e9cbe53 (127.18.70.131:37577): tablet 9e00cc8fa57747a99f9c79e843210821 (table test-table [id=55b7a6f128bf40fc82180bbbab768d3d]) successfully deleted
I20260812 06:59:44.142607 8640 ts_tablet_manager.cc:1918] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260812 06:59:44.142838 8640 log.cc:1196] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/9e00cc8fa57747a99f9c79e843210821
I20260812 06:59:44.143572 8640 ts_tablet_manager.cc:1939] T 9e00cc8fa57747a99f9c79e843210821 P d4ccfb9f5dbd483cba2601936a32a607: Deleting consensus metadata
I20260812 06:59:44.143620 8635 ts_tablet_manager.cc:1905] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:59:44.146173 7670 catalog_manager.cc:4841] TS d4ccfb9f5dbd483cba2601936a32a607 (127.18.70.129:44033): tablet 9e00cc8fa57747a99f9c79e843210821 (table test-table [id=55b7a6f128bf40fc82180bbbab768d3d]) successfully deleted
Aug 12 06:59:44 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 06:59:44.157054 8635 ts_tablet_manager.cc:1918] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260812 06:59:44.157442 8635 log.cc:1196] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/9e00cc8fa57747a99f9c79e843210821
I20260812 06:59:44.158406 8635 ts_tablet_manager.cc:1939] T 9e00cc8fa57747a99f9c79e843210821 P 0b584106c28f4696a813051900050e7c: Deleting consensus metadata
I20260812 06:59:44.160459 8605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:44.116388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49378 (local address 127.18.70.129:44033)
0812 06:59:44.116616 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:44.116624 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:44.128022 (+ 11398us) server_negotiation.cc:407] Connection header received
0812 06:59:44.128394 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:44.128401 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:44.128555 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:44.128650 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:59:44.131858 (+ 3208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:44.133459 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:44.136027 (+ 2568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:44.138340 (+ 2313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:44.138513 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:44.150311 (+ 11798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:59:44.150331 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:59:44.150354 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:59:44.150480 (+ 126us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:59:44.155625 (+ 5145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:44.156888 (+ 1263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:44.156897 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:44.156900 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:44.157214 (+ 314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:44.157853 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:44.157857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:44.157859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:44.158459 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:59:44.158967 (+ 508us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:44.159621 (+ 654us) server_negotiation.cc:299] Negotiation successful
0812 06:59:44.159923 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":86}
I20260812 06:59:44.161504 8086 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:59:44.161463 7671 catalog_manager.cc:4841] TS 0b584106c28f4696a813051900050e7c (127.18.70.130:39035): tablet 9e00cc8fa57747a99f9c79e843210821 (table test-table [id=55b7a6f128bf40fc82180bbbab768d3d]) successfully deleted
I20260812 06:59:44.314719 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 7839
I20260812 06:59:44.343668 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 8104
Aug 12 06:59:44 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 06:59:44.363037 8580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:44.344377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46342 (local address 127.18.70.130:39035)
0812 06:59:44.344592 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:44.344598 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:44.344621 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:59:44.344723 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:44.344729 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:44.344819 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:44.344938 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:59:44.346947 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:44.348111 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:44.349758 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:44.350497 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:44.350613 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:44.355131 (+ 4518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:59:44.355144 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:59:44.355164 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:59:44.355209 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:59:44.360248 (+ 5039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:44.360876 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:44.360885 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:44.360889 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:44.361050 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:44.361367 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:44.361373 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:44.361376 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:44.361824 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:59:44.362193 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:44.362365 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 06:59:44.362590 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 06:59:44.363857 8325 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:59:44.476850 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 8104
I20260812 06:59:44.504645 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 8341
Aug 12 06:59:44 dist-test-slave-tc2s krb5kdc[6837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 06:59:44.518667 8646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:59:44.505372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34780 (local address 127.18.70.131:37577)
0812 06:59:44.505834 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0812 06:59:44.505840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:59:44.505861 (+ 21us) server_negotiation.cc:407] Connection header received
0812 06:59:44.505949 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:59:44.505955 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:59:44.506023 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:59:44.506113 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:59:44.507296 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:44.508033 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:44.509202 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:59:44.509602 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:59:44.509688 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:59:44.513846 (+ 4158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:59:44.513857 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:59:44.513873 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:59:44.513966 (+ 93us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:59:44.516454 (+ 2488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:44.517047 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:44.517053 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:44.517055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:44.517172 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:59:44.517433 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:59:44.517435 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:59:44.517437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:59:44.517775 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:59:44.518043 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0812 06:59:44.518225 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 06:59:44.518400 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":241,"threads_started":1}
I20260812 06:59:44.519273 8546 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:59:44.612257 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 8341
I20260812 06:59:44.637756 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 7649
I20260812 06:59:44.638940 7751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 06:59:44.748485 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 7649
I20260812 06:59:44.779780 18714 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 06:59:45.124184 18714 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 06:59:45.124469 18714 mini_ranger.cc:66] Stopping Ranger...
I20260812 06:59:45.467813 18714 mini_ranger.cc:68] Stopped Ranger
2026-08-12 06:59:45.468 UTC [6894] LOG: received smart shutdown request
2026-08-12 06:59:45.471 UTC [6894] LOG: background worker "logical replication launcher" (PID 6913) exited with exit code 1
2026-08-12 06:59:45.472 UTC [6904] LOG: shutting down
2026-08-12 06:59:45.598 UTC [6894] LOG: database system is shut down
2026-08-12T06:59:45Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50036 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:59:45 dist-test-slave-tc2s krb5kdc[8666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:59:45 dist-test-slave-tc2s krb5kdc[8666](info): set up 2 sockets
Aug 12 06:59:45 dist-test-slave-tc2s krb5kdc[8666](info): commencing operation
krb5kdc: starting...
W20260812 06:59:46.990657 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 06:59:47 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786517987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:59:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:59:47Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.18.70.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.18.70.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/rangeradmin_127.18.70.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/rangeradmin_127.18.70.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.18.70.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.18.70.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/rangerlookup_127.18.70.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/rangerlookup_127.18.70.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.70.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.18.70.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/HTTP_127.18.70.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/HTTP_127.18.70.148@KRBTEST.COM.keytab.
I20260812 06:59:47.286171 18714 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskGv53JZ/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/postgres -l logfile start
2026-08-12 06:59:49.448 UTC [8720] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 06:59:49.448 UTC [8720] LOG: listening on IPv4 address "127.18.70.148", port 35817
2026-08-12 06:59:49.451 UTC [8720] LOG: listening on Unix socket "/tmp/.s.PGSQL.35817"
2026-08-12 06:59:49.473 UTC [8724] LOG: database system was shut down at 2026-08-12 06:59:48 UTC
2026-08-12 06:59:49.476 UTC [8720] LOG: database system is ready to accept connections
I20260812 06:59:50.607963 18714 mini_postgres.cc:96] Postgres bound to 35817
2026-08-12 06:59:50.628 UTC [8739] FATAL: database "slave" does not exist
127.18.70.148:35817 - accepting connections
I20260812 06:59:50.628789 18714 mini_ranger.cc:161] Starting Ranger...
I20260812 06:59:50.654268 18714 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 06:59:51.045279 18714 mini_ranger.cc:87] Created ranger Postgres database
I20260812 06:59:51.045404 18714 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-admin
2026-08-12 06:59:51,341 [I] DB FLAVOR :POSTGRES
2026-08-12 06:59:51,341 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:59:51,341 [I] Checking connection..
2026-08-12 06:59:51,341 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 06:59:51,573 [I] Checking connection passed.
2026-08-12 06:59:51,573 [I] --------- Verifying version history table ---------
2026-08-12 06:59:51,573 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:59:51,811 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:59:51,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:59:52,055 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:59:52,055 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 06:59:52,055 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 06:59:52.306 UTC [8852] WARNING: there is no transaction in progress
2026-08-12 06:59:52,312 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 06:59:52,312 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:59:52,540 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 06:59:52,540 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:59:52,541 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 06:59:52,787 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 06:59:53,037 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-tc2s.c.gcp-upstream.internal','N') ;"
2026-08-12 06:59:53,297 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:59:53,557 [I] Table x_portal_user does not exist in database ranger
2026-08-12 06:59:53,558 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:59:53,846 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 06:59:53,846 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:59:54,128 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:59:54,410 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 06:59:54,411 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 06:59:55.347 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.363 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.377 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.390 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.404 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.420 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.468 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.474 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.486 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.495 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.503 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.515 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.524 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.530 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.535 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:55.541 UTC [9043] WARNING: there is no transaction in progress
2026-08-12 06:59:56,067 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 06:59:56,068 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 06:59:56,320 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 06:59:56,320 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:59:56,577 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 06:59:56,577 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:59:56,811 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 06:59:56,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:59:57,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:59:57,313 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-tc2s.c.gcp-upstream.internal';"
2026-08-12 06:59:57,558 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 06:59:57,559 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 06:59:57,809 [I] DB_PATCHES have already been applied
I20260812 06:59:57.815533 18714 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-admin:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskGv53JZ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 06:59:57.815624 18714 mini_ranger.cc:193] Using host: 127.18.70.148
I20260812 06:59:57.833087 18714 mini_ranger.cc:227] Ranger admin URL: http://127.18.70.148:34157
Aug 12, 2026 6:59:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:59:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:59:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 6:59:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 6:59:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 6:59:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 6:59:58 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 06:59:59.170133 18714 mini_ranger.cc:160] Time spent starting Ranger: real 8.541s user 0.006s sys 0.040s
Aug 12, 2026 7:00:20 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 7:00:20 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 7:00:20 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 7:00:20 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 7:00:21 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 07:00:21.795545 18714 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.18.70.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.18.70.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/rangerkms_127.18.70.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.18.70.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/rangerkms_127.18.70.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.70.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.18.70.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.70.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/HTTP_127.18.70.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.70.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/HTTP_127.18.70.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 07:00:21 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518021, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 07:00:21.961875 18714 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 07:00:21.984063 18714 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 07:00:22.688189 18714 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 07:00:22.688293 18714 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-kms
I20260812 07:00:22.688335 18714 mini_ranger_kms.cc:227] Using postgres at 127.18.70.148:35817
2026-08-12 07:00:23,051 [I] DB FLAVOR :POSTGRES
2026-08-12 07:00:23,052 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 07:00:23,052 [I] Checking connection
2026-08-12 07:00:23,052 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 07:00:23,282 [I] connection success
2026-08-12 07:00:23,282 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 07:00:23,283 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 07:00:23,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 07:00:23,536 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 07:00:23,537 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 07:00:23,537 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 07:00:23,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.70.148:35817/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 07:00:23,809 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 07:00:24.248716 18714 mini_ranger_kms.cc:310] Created kms service
I20260812 07:00:24.451359 18714 mini_ranger_kms.cc:326] Created kudu user
I20260812 07:00:24.496960 18714 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 07:00:24 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518021, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 07:00:24.893162 18714 mini_ranger_kms.cc:384] Added ranger policy
I20260812 07:00:24.893471 18714 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-kms:/tmp/dist-test-taskGv53JZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskGv53JZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 07:00:24.893515 18714 mini_ranger_kms.cc:240] Using host: 127.18.70.148
I20260812 07:00:24.912390 18714 mini_ranger_kms.cc:276] Ranger KMS PID: 9355
I20260812 07:00:24.912513 18714 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.18.70.148:52533
Aug 12, 2026 7:00:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 7:00:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 7:00:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 7:00:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 7:00:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 7:00:26 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 07:00:27 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786518027, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.70.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:27.558671 18714 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.597s user 0.083s sys 0.306s
I20260812 07:00:27.558934 18714 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 07:00:27.559110 18714 mini_ranger_kms.cc:401] 127.18.70.148:52533/kms/v1/keys
Aug 12 07:00:27 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518027, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.70.148@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
Aug 12 07:00:28 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518027, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.70.148@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
Aug 12 07:00:30 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:00:30.414569 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46185
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:46185
--ranger_config_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:52533/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:00:30.754351 9449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:30.754606 9449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:30.754719 9449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:30.761703 9449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:00:30.761798 9449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:30.761868 9449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:30.761972 9449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:00:30.762043 9449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:00:30.771641 9449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal
--ranger_kms_url=127.18.70.148:52533/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:46185
--ranger_config_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:30.772789 9449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:30.774123 9449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:30.787286 9460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:30.787541 9456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:30.787917 9455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:30.788177 9449 server_base.cc:1034] running on GCE node
I20260812 07:00:30.789139 9449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:30.790954 9449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:30.792208 9449 hybrid_clock.cc:648] HybridClock initialized: now 1786518030792159 us; error 29 us; skew 500 ppm
I20260812 07:00:30.792616 9449 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:30 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518030, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:30.796528 9449 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:00:30.798265 9449 webserver.cc:460] Webserver started at http://127.18.70.190:40519/ using document root <none> and password file <none>
I20260812 07:00:30.799104 9449 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:30.799242 9449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:30.799615 9449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 07:00:30 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518030, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 07:00:30.847136 9449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "a3cdcbf770ad449b995d907f5bc13c3b"
format_stamp: "Formatted at 2026-08-12 07:00:30 on dist-test-slave-tc2s"
server_key: "10eb03d8cad7d9d90f0436662368f7e4"
server_key_iv: "ef80252e2906691e3287b72c45d9fedb"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:30.847992 9449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "a3cdcbf770ad449b995d907f5bc13c3b"
format_stamp: "Formatted at 2026-08-12 07:00:30 on dist-test-slave-tc2s"
server_key: "10eb03d8cad7d9d90f0436662368f7e4"
server_key_iv: "ef80252e2906691e3287b72c45d9fedb"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:30.853207 9449 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 07:00:30.871275 9471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:30.872624 9449 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:00:30.872787 9449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "a3cdcbf770ad449b995d907f5bc13c3b"
format_stamp: "Formatted at 2026-08-12 07:00:30 on dist-test-slave-tc2s"
server_key: "10eb03d8cad7d9d90f0436662368f7e4"
server_key_iv: "ef80252e2906691e3287b72c45d9fedb"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:30.872987 9449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:30.909610 9449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:30.913501 9449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:30.913805 9449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:30.932013 9449 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:46185
I20260812 07:00:30.932073 9559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:46185 every 8 connection(s)
I20260812 07:00:30.933290 9449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:00:30.935210 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 9449
I20260812 07:00:30.935429 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:00:30.936118 18714 external_mini_cluster.cc:1428] Setting key 3ac129f2e0fdf3f3252e1c4c0942ddce
I20260812 07:00:30.937691 9561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:30.952062 9561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b: Bootstrap starting.
I20260812 07:00:30.956157 9561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:30.957487 9561 log.cc:824] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:30.960676 9561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b: No bootstrap required, opened a new log
Aug 12 07:00:30 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:30.971184 9570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:30.938135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53834 (local address 127.18.70.190:46185)
0812 07:00:30.952792 (+ 14657us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:30.952807 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:30.952855 (+ 48us) server_negotiation.cc:407] Connection header received
0812 07:00:30.954927 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:30.954959 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:30.955307 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:30.955641 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:30.957136 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:30.958828 (+ 1692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:30.960071 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:30.960730 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:30.960942 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:30.964539 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:30.964547 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:30.964560 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:30.964597 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:30.967471 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:30.968090 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:30.968097 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:30.968102 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:30.968251 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:30.968615 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:30.968619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:30.968620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:30.969132 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:30.969422 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:30.969856 (+ 434us) server_negotiation.cc:299] Negotiation successful
0812 07:00:30.970293 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14398,"thread_start_us":17864,"threads_started":1}
I20260812 07:00:30.971104 9561 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } }
I20260812 07:00:30.971547 9561 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:30.971652 9561 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3cdcbf770ad449b995d907f5bc13c3b, State: Initialized, Role: FOLLOWER
I20260812 07:00:30.972275 9561 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } }
I20260812 07:00:30.972640 9561 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:00:30.972777 9561 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:00:30.972957 9561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:30.975943 9561 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } }
I20260812 07:00:30.976534 9561 leader_election.cc:302] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3cdcbf770ad449b995d907f5bc13c3b; no voters:
I20260812 07:00:30.977151 9561 leader_election.cc:288] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:00:30.977344 9574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:00:30.979231 9561 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:00:30.987105 9574 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 1 LEADER]: Becoming Leader. State: Replica: a3cdcbf770ad449b995d907f5bc13c3b, State: Running, Role: LEADER
I20260812 07:00:30.987720 9574 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } }
I20260812 07:00:30.999558 9578 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3cdcbf770ad449b995d907f5bc13c3b. Latest consensus state: current_term: 1 leader_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } } }
I20260812 07:00:30.999917 9578 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:31.000465 9577 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } } }
I20260812 07:00:31.000746 9577 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:31.004616 9588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:00:31.010629 9588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:00:31.031080 9561 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 07:00:31.032490 9588 catalog_manager.cc:1347] Generated new cluster ID: fd4b4c8601d94744a2eb6943465e40c5
I20260812 07:00:31.032596 9588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:00:31.053241 9588 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:00:31.055349 9588 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:00:31.068984 9588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b: Generated new TSK 0
I20260812 07:00:31.070091 9588 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 07:00:31.823819 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:52533/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46185
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 07:00:32 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786518032, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 07:00:32.189812 9639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:32.190099 9639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:32.190263 9639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:32.197448 9639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:32.197614 9639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:32.197816 9639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:00:32.208969 9639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.18.70.148:52533/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:32.210189 9639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:32.211412 9639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:32.226377 9652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:32.226377 9654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:32.227509 9658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:32.227939 9639 server_base.cc:1034] running on GCE node
I20260812 07:00:32.228585 9639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:32.229746 9639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:32.231037 9639 hybrid_clock.cc:648] HybridClock initialized: now 1786518032230985 us; error 41 us; skew 500 ppm
I20260812 07:00:32.231396 9639 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:32 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518032, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:32.235473 9639 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 07:00:32.237118 9639 webserver.cc:460] Webserver started at http://127.18.70.129:37111/ using document root <none> and password file <none>
I20260812 07:00:32.237733 9639 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:32.237869 9639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:32.238219 9639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 07:00:32 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518032, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 07:00:32.255261 9639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "742b8241619e43a8bee0d1bfeecbf5a4"
format_stamp: "Formatted at 2026-08-12 07:00:32 on dist-test-slave-tc2s"
server_key: "0e178ad6ca72a104b1f8fb96643115b7"
server_key_iv: "8643f3a63852d72152f91ffd0016689e"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:32.256399 9639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "742b8241619e43a8bee0d1bfeecbf5a4"
format_stamp: "Formatted at 2026-08-12 07:00:32 on dist-test-slave-tc2s"
server_key: "0e178ad6ca72a104b1f8fb96643115b7"
server_key_iv: "8643f3a63852d72152f91ffd0016689e"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:32.267762 9639 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.007s sys 0.002s
I20260812 07:00:32.296756 9671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:32.302745 9639 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.004s sys 0.004s
I20260812 07:00:32.302966 9639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "742b8241619e43a8bee0d1bfeecbf5a4"
format_stamp: "Formatted at 2026-08-12 07:00:32 on dist-test-slave-tc2s"
server_key: "0e178ad6ca72a104b1f8fb96643115b7"
server_key_iv: "8643f3a63852d72152f91ffd0016689e"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:32.303263 9639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:32.406448 9639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:32.410466 9639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:32.410742 9639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:32.411728 9639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:32.413216 9639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:32.413300 9639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:32.413432 9639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:32.413492 9639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 07:00:32 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518032, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 07:00:32.627616 9639 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:46563
I20260812 07:00:32.627842 9861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:46563 every 8 connection(s)
I20260812 07:00:32.629285 9639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:00:32.631759 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 9639
I20260812 07:00:32.631976 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 07:00:32.632797 18714 external_mini_cluster.cc:1428] Setting key 243da0fce0588b2e9bd2d1bc4e1b3f9d
Aug 12 07:00:32 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518032, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
I20260812 07:00:32.706503 9865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:32.648445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:33045 (local address 127.18.70.190:46185)
0812 07:00:32.671037 (+ 22592us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:32.671045 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:32.674140 (+ 3095us) server_negotiation.cc:407] Connection header received
0812 07:00:32.678639 (+ 4499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:32.678646 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:32.678751 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:32.678837 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:32.684095 (+ 5258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:32.685309 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:32.694020 (+ 8711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:32.694620 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:32.694716 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:32.699111 (+ 4395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:32.699118 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:32.699123 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:32.699166 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:32.702713 (+ 3547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:32.703630 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:32.703637 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:32.703641 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:32.703791 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:32.704376 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:32.704382 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:32.704385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:32.704748 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:32.704877 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:32.705860 (+ 983us) server_negotiation.cc:299] Negotiation successful
0812 07:00:32.706122 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22445,"thread_start_us":22597,"threads_started":1}
I20260812 07:00:32.708773 9864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:32.647643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46185 (local address 127.18.70.129:33045)
0812 07:00:32.672091 (+ 24448us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:32.672604 (+ 513us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:32.678286 (+ 5682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:32.679461 (+ 1175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:32.679472 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:32.682138 (+ 2666us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:32.683704 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:32.683728 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:32.685517 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:32.685522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:32.687485 (+ 1963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:32.687531 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:32.695076 (+ 7545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:32.695083 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:32.695375 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:32.696189 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:32.696217 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:32.698848 (+ 2631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:32.702879 (+ 4031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:32.702889 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:32.702907 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:32.703486 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:32.703960 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:32.703965 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:32.703968 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:32.704244 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:32.704980 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:32.704988 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:32.705420 (+ 432us) client_negotiation.cc:769] Sending connection context
0812 07:00:32.706900 (+ 1480us) client_negotiation.cc:240] Negotiation successful
0812 07:00:32.707446 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23765,"thread_start_us":28302,"threads_started":1}
I20260812 07:00:32.710719 9862 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46185
I20260812 07:00:32.711030 9862 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:32.711863 9862 heartbeater.cc:511] Master 127.18.70.190:46185 requested a full tablet report, sending...
I20260812 07:00:32.714389 9499 ts_manager.cc:194] Registered new tserver with Master: 742b8241619e43a8bee0d1bfeecbf5a4 (127.18.70.129:46563)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
I20260812 07:00:32.716420 9499 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:33045
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
W20260812 07:00:32.749553 18714 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.18.70.130: real 0.114s user 0.000s sys 0.021s
I20260812 07:00:32.750725 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:52533/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46185
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 07:00:32 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518032, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
W20260812 07:00:33.182552 9868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:33.182807 9868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:33.182972 9868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:33.190280 9868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:33.190394 9868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:33.190547 9868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:00:33.204288 9868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.18.70.148:52533/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:33.206043 9868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:33.207753 9868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:33.227469 9890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:33.227578 9897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:33.228145 9904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:33.228821 9868 server_base.cc:1034] running on GCE node
I20260812 07:00:33.229405 9868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:33.230300 9868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:33.231493 9868 hybrid_clock.cc:648] HybridClock initialized: now 1786518033231451 us; error 36 us; skew 500 ppm
I20260812 07:00:33.231804 9868 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:33 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518033, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:33.235008 9868 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 07:00:33.236286 9868 webserver.cc:460] Webserver started at http://127.18.70.130:42643/ using document root <none> and password file <none>
I20260812 07:00:33.236896 9868 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:33.236990 9868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:33.237232 9868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 07:00:33 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518033, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 07:00:33.252892 9868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "6cb02732a7d84ee0a4a2883a45de45ec"
format_stamp: "Formatted at 2026-08-12 07:00:33 on dist-test-slave-tc2s"
server_key: "a745c409505b7019ef522e8bcc0b4700"
server_key_iv: "aac5b6196332502ab135937f11f5806e"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:33.253667 9868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "6cb02732a7d84ee0a4a2883a45de45ec"
format_stamp: "Formatted at 2026-08-12 07:00:33 on dist-test-slave-tc2s"
server_key: "a745c409505b7019ef522e8bcc0b4700"
server_key_iv: "aac5b6196332502ab135937f11f5806e"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:33.258508 9868 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260812 07:00:33.273077 9919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:33.274734 9868 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 07:00:33.274895 9868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "6cb02732a7d84ee0a4a2883a45de45ec"
format_stamp: "Formatted at 2026-08-12 07:00:33 on dist-test-slave-tc2s"
server_key: "a745c409505b7019ef522e8bcc0b4700"
server_key_iv: "aac5b6196332502ab135937f11f5806e"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:33.275146 9868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:33.298548 9868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:33.303066 9868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:33.303366 9868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:33.304416 9868 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:33.306084 9868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:33.306180 9868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:33.306304 9868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:33.306367 9868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:33.336303 9868 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:42529
I20260812 07:00:33.336351 10106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:42529 every 8 connection(s)
I20260812 07:00:33.337477 9868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:00:33.340376 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 9868
I20260812 07:00:33.340530 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 07:00:33.340969 18714 external_mini_cluster.cc:1428] Setting key 8d6fee237a715a33c57804a1e6216d2a
Aug 12 07:00:33 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518033, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:33.358352 10110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:33.339806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:58673 (local address 127.18.70.190:46185)
0812 07:00:33.340275 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:33.340282 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:33.341296 (+ 1014us) server_negotiation.cc:407] Connection header received
0812 07:00:33.343512 (+ 2216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:33.343516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:33.343580 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:33.343667 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:33.345349 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:33.346107 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:33.348195 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:33.348631 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:33.348731 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:33.352458 (+ 3727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:33.352463 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:33.352467 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:33.352498 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:33.355449 (+ 2951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:33.356123 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:33.356128 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:33.356133 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:33.356308 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:33.356662 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:33.356666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:33.356669 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:33.357003 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:33.357162 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:33.357728 (+ 566us) server_negotiation.cc:299] Negotiation successful
0812 07:00:33.357984 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":205,"threads_started":1}
I20260812 07:00:33.358932 10111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:33.340349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46185 (local address 127.18.70.130:58673)
0812 07:00:33.341129 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:33.341181 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:33.343224 (+ 2043us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:33.343926 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:33.343936 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:33.344443 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:33.345201 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:33.345226 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:33.346263 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:33.346267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:33.348020 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:33.348049 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:33.348847 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:33.348853 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:33.349122 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:33.349782 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:33.349808 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:33.352235 (+ 2427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:33.355595 (+ 3360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:33.355601 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:33.355611 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:33.356009 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:33.356411 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:33.356414 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:33.356416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:33.356570 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:33.357107 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:33.357111 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:33.357384 (+ 273us) client_negotiation.cc:769] Sending connection context
0812 07:00:33.357593 (+ 209us) client_negotiation.cc:240] Negotiation successful
0812 07:00:33.357959 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":320,"threads_started":1}
I20260812 07:00:33.360141 10107 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46185
I20260812 07:00:33.360488 10107 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:33.361126 10107 heartbeater.cc:511] Master 127.18.70.190:46185 requested a full tablet report, sending...
I20260812 07:00:33.362500 9499 ts_manager.cc:194] Registered new tserver with Master: 6cb02732a7d84ee0a4a2883a45de45ec (127.18.70.130:42529)
I20260812 07:00:33.363250 9499 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:58673
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 07:00:33.394568 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:52533/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46185
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:00:33.712476 10115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:33.712728 10115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:33.712858 10115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:33.719648 10115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:33.719749 10115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:33.719897 10115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:00:33.719882 9862 heartbeater.cc:503] Master 127.18.70.190:46185 was elected leader, sending a full tablet report...
I20260812 07:00:33.730127 10115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.18.70.148:52533/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:46185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:33.731206 10115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:33.732358 10115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:33.744112 10122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:33.744170 10127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:33.744282 10129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:33.744971 10115 server_base.cc:1034] running on GCE node
I20260812 07:00:33.745507 10115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:33.746363 10115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:33.747551 10115 hybrid_clock.cc:648] HybridClock initialized: now 1786518033747508 us; error 32 us; skew 500 ppm
I20260812 07:00:33.747815 10115 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:33 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518033, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:33.750659 10115 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 07:00:33.751992 10115 webserver.cc:460] Webserver started at http://127.18.70.131:33347/ using document root <none> and password file <none>
I20260812 07:00:33.752589 10115 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:33.752702 10115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:33.752977 10115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 07:00:33 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518033, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 07:00:33.766917 10115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc"
format_stamp: "Formatted at 2026-08-12 07:00:33 on dist-test-slave-tc2s"
server_key: "3c696c9b8432ed215e6ee14f5897a842"
server_key_iv: "c814f561254cddc142bb83cb0ebd8712"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:33.767680 10115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc"
format_stamp: "Formatted at 2026-08-12 07:00:33 on dist-test-slave-tc2s"
server_key: "3c696c9b8432ed215e6ee14f5897a842"
server_key_iv: "c814f561254cddc142bb83cb0ebd8712"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:33.772780 10115 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 07:00:33.787508 10140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:33.789106 10115 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 07:00:33.789283 10115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc"
format_stamp: "Formatted at 2026-08-12 07:00:33 on dist-test-slave-tc2s"
server_key: "3c696c9b8432ed215e6ee14f5897a842"
server_key_iv: "c814f561254cddc142bb83cb0ebd8712"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:33.789536 10115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:33.814218 10115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:33.818677 10115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:33.818992 10115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:33.820005 10115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:33.821593 10115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:33.821686 10115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:33.821810 10115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:33.821873 10115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:33.852452 10115 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:35027
I20260812 07:00:33.852469 10323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:35027 every 8 connection(s)
I20260812 07:00:33.853988 10115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:00:33.863092 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 10115
I20260812 07:00:33.863260 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 07:00:33.863876 18714 external_mini_cluster.cc:1428] Setting key 164346b1ae18c70b7444cb6572bd8268
Aug 12 07:00:33 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518033, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:33.873195 10110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:33.856492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:32907 (local address 127.18.70.190:46185)
0812 07:00:33.856706 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:33.856712 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:33.857778 (+ 1066us) server_negotiation.cc:407] Connection header received
0812 07:00:33.859541 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:33.859547 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:33.859671 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:33.859791 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:33.861076 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:33.862235 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:33.863782 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:33.864257 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:33.864369 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:33.868015 (+ 3646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:33.868019 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:33.868023 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:33.868054 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:33.870407 (+ 2353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:33.871231 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:33.871235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:33.871237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:33.871350 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:33.871766 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:33.871769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:33.871771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:33.872013 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:33.872122 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:33.872812 (+ 690us) server_negotiation.cc:299] Negotiation successful
0812 07:00:33.872980 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 07:00:33.874472 10327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:33.856875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46185 (local address 127.18.70.131:32907)
0812 07:00:33.857609 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:33.857651 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:33.859285 (+ 1634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:33.859985 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:33.859992 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:33.860387 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:33.860911 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:33.860927 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:33.862362 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:33.862366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:33.863648 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:33.863661 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:33.864462 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:33.864470 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:33.864681 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:33.865398 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:33.865420 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:33.867810 (+ 2390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:33.870541 (+ 2731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:33.870550 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:33.870563 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:33.871132 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:33.871444 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:33.871449 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:33.871453 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:33.871675 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:33.872124 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:33.872132 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:33.872481 (+ 349us) client_negotiation.cc:769] Sending connection context
0812 07:00:33.872766 (+ 285us) client_negotiation.cc:240] Negotiation successful
0812 07:00:33.873230 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":301,"threads_started":1}
I20260812 07:00:33.875720 10324 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46185
I20260812 07:00:33.875964 10324 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:33.876596 10324 heartbeater.cc:511] Master 127.18.70.190:46185 requested a full tablet report, sending...
I20260812 07:00:33.878043 9499 ts_manager.cc:194] Registered new tserver with Master: f3a590fe9e044ecb97b32abfb8d8bcbc (127.18.70.131:35027)
I20260812 07:00:33.879208 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 07:00:33.879180 9499 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:32907
I20260812 07:00:33.881268 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 9639
Aug 12 07:00:33 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 07:00:33.899330 10329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:33.882230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56788 (local address 127.18.70.129:46563)
0812 07:00:33.882886 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:33.882894 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:33.883247 (+ 353us) server_negotiation.cc:407] Connection header received
0812 07:00:33.883378 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:33.883386 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:33.883607 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:33.883766 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:33.885048 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:33.886605 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:33.888100 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:33.888901 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:33.889041 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:33.893146 (+ 4105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:33.893160 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:33.893175 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:33.893218 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:33.896667 (+ 3449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:33.897277 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:33.897285 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:33.897289 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:33.897465 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:33.897759 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:33.897764 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:33.897767 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:33.898186 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:33.898474 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:33.898683 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 07:00:33.898934 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":318,"threads_started":1}
I20260812 07:00:33.900449 9852 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:33.981778 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 9639
I20260812 07:00:34.012223 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 9868
Aug 12 07:00:34 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 07:00:34.029163 10336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:34.013057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51362 (local address 127.18.70.130:42529)
0812 07:00:34.013812 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:34.013819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:34.013844 (+ 25us) server_negotiation.cc:407] Connection header received
0812 07:00:34.013929 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:34.013938 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:34.014164 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:34.014304 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:34.015546 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:34.016661 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:34.018149 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:34.018682 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:34.019396 (+ 714us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:34.023433 (+ 4037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:34.023444 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:34.023457 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:34.023495 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:34.026464 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:34.027274 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:34.027279 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:34.027282 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:34.027405 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:34.027780 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:34.027783 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:34.027785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:34.028098 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:34.028322 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:34.028642 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 07:00:34.028831 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":511,"threads_started":1}
I20260812 07:00:34.030503 10101 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:34.109601 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 9868
I20260812 07:00:34.143805 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 10115
Aug 12 07:00:34 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 07:00:34.161192 10343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:34.144849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55742 (local address 127.18.70.131:35027)
0812 07:00:34.145528 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:34.145535 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:34.145564 (+ 29us) server_negotiation.cc:407] Connection header received
0812 07:00:34.145623 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:34.145629 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:34.145842 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:34.146050 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:34.147679 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:34.148674 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:34.150611 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:34.151190 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:34.151284 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:34.155830 (+ 4546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:34.155841 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:34.155854 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:34.155885 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:34.158617 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:34.159340 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:34.159346 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:34.159348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:34.159475 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:34.159819 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:34.159822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:34.159824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:34.160134 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:34.160389 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:34.160669 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 07:00:34.160859 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":371,"threads_started":1}
I20260812 07:00:34.162521 10317 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:34.243381 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 10115
I20260812 07:00:34.264321 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 9449
I20260812 07:00:34.265642 9552 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:34.368124 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 9449
I20260812 07:00:34.402045 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46185
--webserver_interface=127.18.70.190
--webserver_port=40519
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:46185
--ranger_config_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:52533/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.70.148:52533/kms with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:00:34.715437 10346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:34.715716 10346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:34.715809 10346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:34.722602 10346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:00:34.722689 10346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:34.722738 10346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:34.722790 10346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:00:34.722834 10346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:00:34.731973 10346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.70.148:52533/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:46185
--ranger_config_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=40519
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:34.732952 10346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:34.734117 10346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:34.744750 10358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:34.744843 10362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:34.744804 10359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:34.745379 10346 server_base.cc:1034] running on GCE node
I20260812 07:00:34.746097 10346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:34.747242 10346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:34.748435 10346 hybrid_clock.cc:648] HybridClock initialized: now 1786518034748387 us; error 42 us; skew 500 ppm
I20260812 07:00:34.748733 10346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:34 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518034, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:34.754587 10346 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:00:34.755854 10346 webserver.cc:460] Webserver started at http://127.18.70.190:40519/ using document root <none> and password file <none>
I20260812 07:00:34.756428 10346 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:34.756533 10346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 07:00:34 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518034, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 07:00:34.831730 10346 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 07:00:34.834753 10380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:34.836032 10346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:00:34.836181 10346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "a3cdcbf770ad449b995d907f5bc13c3b"
format_stamp: "Formatted at 2026-08-12 07:00:30 on dist-test-slave-tc2s"
server_key: "10eb03d8cad7d9d90f0436662368f7e4"
server_key_iv: "ef80252e2906691e3287b72c45d9fedb"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:34.837085 10346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:34.863691 10346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:34.866951 10346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:34.867200 10346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:34.883612 10346 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:46185
I20260812 07:00:34.883646 10471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:46185 every 8 connection(s)
I20260812 07:00:34.884905 10346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:00:34.891184 10472 sys_catalog.cc:263] Verifying existing consensus state
I20260812 07:00:34.893263 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 10346
I20260812 07:00:34.894347 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:52533/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:46563
--local_ip_for_outbound_sockets=127.18.70.129
--tserver_master_addrs=127.18.70.190:46185
--webserver_port=37111
--webserver_interface=127.18.70.129
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.70.148:52533/kms with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:00:34.894917 10472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b: Bootstrap starting.
I20260812 07:00:34.914639 10472 log.cc:824] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:34.922741 10472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 07:00:34.923208 10472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b: Bootstrap complete.
I20260812 07:00:34.931627 10472 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } }
I20260812 07:00:34.932389 10472 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3cdcbf770ad449b995d907f5bc13c3b, State: Initialized, Role: FOLLOWER
I20260812 07:00:34.932940 10472 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } }
I20260812 07:00:34.933145 10472 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:00:34.933255 10472 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:00:34.933404 10472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 1 FOLLOWER]: Advancing to term 2
I20260812 07:00:34.936975 10472 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } }
I20260812 07:00:34.937402 10472 leader_election.cc:302] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3cdcbf770ad449b995d907f5bc13c3b; no voters:
I20260812 07:00:34.937960 10472 leader_election.cc:288] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 07:00:34.938094 10479 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 2 FOLLOWER]: Leader election won for term 2
I20260812 07:00:34.939779 10479 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [term 2 LEADER]: Becoming Leader. State: Replica: a3cdcbf770ad449b995d907f5bc13c3b, State: Running, Role: LEADER
I20260812 07:00:34.939950 10472 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:00:34.940307 10479 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } }
I20260812 07:00:34.947126 10486 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3cdcbf770ad449b995d907f5bc13c3b. Latest consensus state: current_term: 2 leader_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } } }
I20260812 07:00:34.947530 10486 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:34.948041 10482 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3cdcbf770ad449b995d907f5bc13c3b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46185 } } }
I20260812 07:00:34.948318 10482 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:34.948321 10496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:00:34.961844 10496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:00:34.963362 10496 catalog_manager.cc:1259] Loaded cluster ID: fd4b4c8601d94744a2eb6943465e40c5
I20260812 07:00:34.963482 10496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:00:34.967506 10496 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:00:34.969028 10496 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b: Loaded TSK: 0
I20260812 07:00:34.970563 10496 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:00:34.973237 10472 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260812 07:00:35.337639 10475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:35.338093 10475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:35.338294 10475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:35.349359 10475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:35.349521 10475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:35.349731 10475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:00:35.364730 10475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.70.148:52533/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:46563
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=37111
--tserver_master_addrs=127.18.70.190:46185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:35.366478 10475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:35.368290 10475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:35.388274 10532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:35.388942 10533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:35.394102 10475 server_base.cc:1034] running on GCE node
W20260812 07:00:35.394703 10535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:35.395448 10475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:35.396809 10475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:35.398102 10475 hybrid_clock.cc:648] HybridClock initialized: now 1786518035398012 us; error 75 us; skew 500 ppm
I20260812 07:00:35.398499 10475 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:35 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518035, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:35.402472 10475 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 07:00:35.405077 10475 webserver.cc:460] Webserver started at http://127.18.70.129:37111/ using document root <none> and password file <none>
I20260812 07:00:35.406121 10475 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:35.406319 10475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 07:00:35 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518035, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 07:00:35.449652 10475 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.006s sys 0.001s
I20260812 07:00:35.458659 10549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:35.460424 10475 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.005s sys 0.003s
I20260812 07:00:35.460649 10475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "742b8241619e43a8bee0d1bfeecbf5a4"
format_stamp: "Formatted at 2026-08-12 07:00:32 on dist-test-slave-tc2s"
server_key: "0e178ad6ca72a104b1f8fb96643115b7"
server_key_iv: "8643f3a63852d72152f91ffd0016689e"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:35.462212 10475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:35.483271 10475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:35.487998 10475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:35.488335 10475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:35.490583 10475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:35.492307 10475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:35.492465 10475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 07:00:35.492636 10475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:35.492767 10475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:35.566376 10475 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:46563
I20260812 07:00:35.566421 10720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:46563 every 8 connection(s)
I20260812 07:00:35.568260 10475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:00:35.572229 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 10475
I20260812 07:00:35.573046 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:52533/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:42529
--local_ip_for_outbound_sockets=127.18.70.130
--tserver_master_addrs=127.18.70.190:46185
--webserver_port=42643
--webserver_interface=127.18.70.130
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.70.148:52533/kms with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 07:00:35 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518035, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:35.611768 10727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:35.573276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46185 (local address 127.18.70.129:43387)
0812 07:00:35.574217 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:35.574269 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:35.576703 (+ 2434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:35.578267 (+ 1564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:35.578276 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:35.579632 (+ 1356us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:35.585988 (+ 6356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:35.586014 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:35.593783 (+ 7769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:35.593789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:35.595078 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:35.595098 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:35.596311 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:35.596318 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:35.596586 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:35.597292 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:35.597325 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:35.599545 (+ 2220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:35.604981 (+ 5436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:35.604991 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:35.605005 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:35.605655 (+ 650us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:35.608326 (+ 2671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:35.608332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:35.608336 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:35.608558 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:35.609484 (+ 926us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:35.609492 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:35.609839 (+ 347us) client_negotiation.cc:769] Sending connection context
0812 07:00:35.610154 (+ 315us) client_negotiation.cc:240] Negotiation successful
0812 07:00:35.610652 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":2645,"threads_started":1}
I20260812 07:00:35.613731 10728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:35.574325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:43387 (local address 127.18.70.190:46185)
0812 07:00:35.575638 (+ 1313us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:35.575654 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:35.575702 (+ 48us) server_negotiation.cc:407] Connection header received
0812 07:00:35.577449 (+ 1747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:35.577461 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:35.577756 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:35.578125 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:35.591842 (+ 13717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:35.593554 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:35.595283 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:35.596084 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:35.596261 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:35.599851 (+ 3590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:35.599863 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:35.599881 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:35.599927 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:35.603609 (+ 3682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:35.607951 (+ 4342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:35.607959 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:35.607967 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:35.608190 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:35.608706 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:35.608710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:35.608714 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:35.609324 (+ 610us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:35.612502 (+ 3178us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:35.612690 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 07:00:35.612956 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1045,"thread_start_us":2509,"threads_started":1}
I20260812 07:00:35.616865 10724 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46185
I20260812 07:00:35.617149 10724 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:35.617827 10724 heartbeater.cc:511] Master 127.18.70.190:46185 requested a full tablet report, sending...
W20260812 07:00:35.620393 10724 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:46185 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 07:00:35.620600 10724 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:35.620857 10724 heartbeater.cc:511] Master 127.18.70.190:46185 requested a full tablet report, sending...
I20260812 07:00:35.622022 10724 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:35.622255 10724 heartbeater.cc:511] Master 127.18.70.190:46185 requested a full tablet report, sending...
W20260812 07:00:35.623267 10724 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 07:00:35.975428 10729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:35.975677 10729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:35.975832 10729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:35.983320 10729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:35.983474 10729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:35.983664 10729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:00:35.993003 10729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.70.148:52533/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:42529
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=42643
--tserver_master_addrs=127.18.70.190:46185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:35.994222 10729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:35.995426 10729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:36.022838 10752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:36.022866 10753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:36.026445 10756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:36.027444 10729 server_base.cc:1034] running on GCE node
I20260812 07:00:36.028264 10729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:36.029526 10729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:36.030791 10729 hybrid_clock.cc:648] HybridClock initialized: now 1786518036030729 us; error 35 us; skew 500 ppm
I20260812 07:00:36.031191 10729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:36 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:36.035113 10729 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 07:00:36.037007 10729 webserver.cc:460] Webserver started at http://127.18.70.130:42643/ using document root <none> and password file <none>
I20260812 07:00:36.037952 10729 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:36.038127 10729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 07:00:36 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 07:00:36.078929 10729 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.006s sys 0.001s
I20260812 07:00:36.098491 10771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:36.100459 10729 fs_manager.cc:725] Time spent opening block manager: real 0.020s user 0.003s sys 0.012s
I20260812 07:00:36.100728 10729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "6cb02732a7d84ee0a4a2883a45de45ec"
format_stamp: "Formatted at 2026-08-12 07:00:33 on dist-test-slave-tc2s"
server_key: "a745c409505b7019ef522e8bcc0b4700"
server_key_iv: "aac5b6196332502ab135937f11f5806e"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:36.102188 10729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:36.121352 10729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:36.126232 10729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:36.126597 10729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:36.127799 10729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:36.129495 10729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:36.129659 10729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 07:00:36.129803 10729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:36.129948 10729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 07:00:36 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786518036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:36.222208 10729 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:42529
I20260812 07:00:36.222267 10957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:42529 every 8 connection(s)
I20260812 07:00:36.224097 10729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:00:36.230986 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 10729
I20260812 07:00:36.231717 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.70.148:52533/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:35027
--local_ip_for_outbound_sockets=127.18.70.131
--tserver_master_addrs=127.18.70.190:46185
--webserver_port=33347
--webserver_interface=127.18.70.131
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.70.148:52533/kms with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 07:00:36 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:36.254582 10965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:36.227911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46185 (local address 127.18.70.130:42463)
0812 07:00:36.229361 (+ 1450us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:36.229409 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:36.231765 (+ 2356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:36.236523 (+ 4758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:36.236546 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:36.237179 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:36.237967 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:36.237994 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:36.239648 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:36.239653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:36.241608 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:36.241633 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:36.242827 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:36.242834 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:36.243088 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:36.243816 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:36.243848 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:36.246374 (+ 2526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:36.250141 (+ 3767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:36.250149 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:36.250165 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:36.250696 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:36.251127 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:36.251132 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:36.251135 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:36.251349 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:36.252077 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:36.252085 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:36.252454 (+ 369us) client_negotiation.cc:769] Sending connection context
0812 07:00:36.252752 (+ 298us) client_negotiation.cc:240] Negotiation successful
0812 07:00:36.253245 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1148,"thread_start_us":934,"threads_started":1}
I20260812 07:00:36.255836 10966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:36.228733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:42463 (local address 127.18.70.190:46185)
0812 07:00:36.233885 (+ 5152us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:36.233912 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:36.233933 (+ 21us) server_negotiation.cc:407] Connection header received
0812 07:00:36.234000 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:36.234006 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:36.234092 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:36.234205 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:36.238204 (+ 3999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:36.239427 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:36.241782 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:36.242385 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:36.242475 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:36.246620 (+ 4145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:36.246626 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:36.246631 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:36.246671 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:36.249987 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:36.250847 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:36.250852 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:36.250855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:36.251002 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:36.251495 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:36.251500 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:36.251503 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:36.251859 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:36.251995 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:36.255307 (+ 3312us) server_negotiation.cc:299] Negotiation successful
0812 07:00:36.255511 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5023,"thread_start_us":10512,"threads_started":1}
I20260812 07:00:36.257906 10961 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46185
I20260812 07:00:36.258220 10961 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:36.258878 10961 heartbeater.cc:511] Master 127.18.70.190:46185 requested a full tablet report, sending...
I20260812 07:00:36.260762 10411 ts_manager.cc:194] Registered new tserver with Master: 6cb02732a7d84ee0a4a2883a45de45ec (127.18.70.130:42529)
I20260812 07:00:36.262379 10411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:42463
I20260812 07:00:36.623417 10724 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:36.623878 10724 heartbeater.cc:511] Master 127.18.70.190:46185 requested a full tablet report, sending...
I20260812 07:00:36.625200 10411 ts_manager.cc:194] Registered new tserver with Master: 742b8241619e43a8bee0d1bfeecbf5a4 (127.18.70.129:46563)
I20260812 07:00:36.626431 10411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:43387
Aug 12 07:00:36 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
W20260812 07:00:36.733469 10967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:36.733959 10967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:36.734158 10967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:36.745481 10967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:36.745657 10967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:36.745882 10967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:00:36.761399 10967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.70.148:52533/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:35027
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=33347
--tserver_master_addrs=127.18.70.190:46185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:36.763415 10967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:36.765269 10967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:36.791774 10981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:36.793875 10984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:36.794369 10978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:36.794430 10967 server_base.cc:1034] running on GCE node
I20260812 07:00:36.795360 10967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:36.796496 10967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:36.797737 10967 hybrid_clock.cc:648] HybridClock initialized: now 1786518036797658 us; error 57 us; skew 500 ppm
I20260812 07:00:36.798120 10967 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:36 dist-test-slave-tc2s krb5kdc[8666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:36.802260 10967 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 07:00:36.807471 10967 webserver.cc:460] Webserver started at http://127.18.70.131:33347/ using document root <none> and password file <none>
I20260812 07:00:36.808410 10967 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:36.808575 10967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 07:00:36 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 07:00:36.852042 10967 fs_manager.cc:709] Time spent opening directory manager: real 0.021s user 0.008s sys 0.012s
I20260812 07:00:36.855873 10994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:36.857491 10967 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 07:00:36.857725 10967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc"
format_stamp: "Formatted at 2026-08-12 07:00:33 on dist-test-slave-tc2s"
server_key: "3c696c9b8432ed215e6ee14f5897a842"
server_key_iv: "c814f561254cddc142bb83cb0ebd8712"
server_key_version: "kuduclusterkey@0"
I20260812 07:00:36.859303 10967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:36.882287 10967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:36.889796 10967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:36.890159 10967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:36.897516 10967 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:36.898958 10967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:36.899055 10967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:36.899160 10967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:36.899230 10967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:36.946202 10967 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:35027
I20260812 07:00:36.946283 11180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:35027 every 8 connection(s)
I20260812 07:00:36.948035 10967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:00:36.958406 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 10967
Aug 12 07:00:36 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:36.984884 11191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:36.951453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46185 (local address 127.18.70.131:54049)
0812 07:00:36.962819 (+ 11366us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:36.962872 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:36.965248 (+ 2376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:36.966330 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:36.966341 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:36.966911 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:36.967703 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:36.967730 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:36.969288 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:36.969294 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:36.971299 (+ 2005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:36.971315 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:36.972611 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:36.972620 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:36.972889 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:36.973650 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:36.973685 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:36.976390 (+ 2705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:36.980439 (+ 4049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:36.980448 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:36.980462 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:36.980995 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:36.981487 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:36.981492 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:36.981496 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:36.981728 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:36.982438 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:36.982447 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:36.982827 (+ 380us) client_negotiation.cc:769] Sending connection context
0812 07:00:36.983113 (+ 286us) client_negotiation.cc:240] Negotiation successful
0812 07:00:36.983599 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11077,"thread_start_us":11160,"threads_started":1}
I20260812 07:00:36.985661 11188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:36.950917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:54049 (local address 127.18.70.190:46185)
0812 07:00:36.962689 (+ 11772us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:36.962695 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:36.963604 (+ 909us) server_negotiation.cc:407] Connection header received
0812 07:00:36.965635 (+ 2031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:36.965641 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:36.965749 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:36.965856 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:36.967926 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:36.969091 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:36.971479 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:36.972149 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:36.972271 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:36.976651 (+ 4380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:36.976658 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:36.976664 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:36.976704 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:36.980256 (+ 3552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:36.981179 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:36.981184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:36.981191 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:36.981354 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:36.981919 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:36.981925 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:36.981929 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:36.982290 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:36.984910 (+ 2620us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:36.985071 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 07:00:36.985299 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11639,"thread_start_us":12699,"threads_started":1}
I20260812 07:00:36.986970 11181 heartbeater.cc:347] Connected to a master server at 127.18.70.190:46185
I20260812 07:00:36.987293 11181 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:36.988121 11181 heartbeater.cc:511] Master 127.18.70.190:46185 requested a full tablet report, sending...
I20260812 07:00:36.989881 10411 ts_manager.cc:194] Registered new tserver with Master: f3a590fe9e044ecb97b32abfb8d8bcbc (127.18.70.131:35027)
I20260812 07:00:36.991052 10411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:54049
I20260812 07:00:36.996549 11195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:36.962332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51210 (local address 127.18.70.190:46185)
0812 07:00:36.977472 (+ 15140us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:36.977479 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:36.978097 (+ 618us) server_negotiation.cc:407] Connection header received
0812 07:00:36.978399 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:36.978404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:36.978519 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:36.978611 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:36.981060 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:36.982318 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:36.984347 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:36.985000 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:36.985084 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:36.988831 (+ 3747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:36.988838 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:36.988844 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:36.988878 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:36.992386 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:36.993320 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:36.993326 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:36.993329 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:36.993474 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:36.993965 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:36.993970 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:36.993973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:36.994304 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:36.994580 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:36.995995 (+ 1415us) server_negotiation.cc:299] Negotiation successful
0812 07:00:36.996215 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15003,"thread_start_us":14831,"threads_started":1}
I20260812 07:00:36.999430 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 07:00:37 dist-test-slave-tc2s krb5kdc[8666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518036, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for HTTP/127.18.70.148@KRBTEST.COM
I20260812 07:00:37.046623 11195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.025845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51214 (local address 127.18.70.190:46185)
0812 07:00:37.026079 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:37.026086 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:37.032267 (+ 6181us) server_negotiation.cc:407] Connection header received
0812 07:00:37.032444 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:37.032450 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:37.032520 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:37.032606 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:37.034231 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.035154 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.036724 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.037411 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.037554 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.040548 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:37.040555 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:37.040559 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:37.040599 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:37.043921 (+ 3322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:37.044666 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:37.044673 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:37.044677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:37.044830 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:37.045300 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:37.045305 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:37.045309 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:37.045594 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:37.045814 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:37.046142 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 07:00:37.046355 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260812 07:00:37.052098 10411 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 07:00:37.064427 10411 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 07:00:37.132726 11222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.109403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:42529 (local address 127.0.0.1:51368)
0812 07:00:37.119832 (+ 10429us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:37.119885 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:37.120093 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:37.121977 (+ 1884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:37.121984 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:37.122016 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:37.122489 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:37.122505 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.124533 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.124540 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:37.128244 (+ 3704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:37.128263 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.130688 (+ 2425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.130694 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:37.131808 (+ 1114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.131880 (+ 72us) client_negotiation.cc:769] Sending connection context
0812 07:00:37.131980 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 07:00:37.132167 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10159,"thread_start_us":12493,"threads_started":1}
I20260812 07:00:37.134460 11219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.109509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51368 (local address 127.18.70.130:42529)
0812 07:00:37.114279 (+ 4770us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:37.114288 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:37.120011 (+ 5723us) server_negotiation.cc:407] Connection header received
0812 07:00:37.121272 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:37.121280 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:37.121508 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:37.121686 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:37.122681 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.124355 (+ 1674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.128501 (+ 4146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.130446 (+ 1945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.133513 (+ 3067us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.133716 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:37.133829 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 07:00:37.134038 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4601,"thread_start_us":4562,"threads_started":1}
I20260812 07:00:37.143391 10848 tablet_service.cc:1467] Processing CreateTablet for tablet 3dfeda98057e45af8bb91e3caa089946 (DEFAULT_TABLE table=test-table [id=5fcf87a769554e419193d4d4afe03d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:00:37.145485 10848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dfeda98057e45af8bb91e3caa089946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:37.153647 11223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.135661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46563 (local address 127.0.0.1:56798)
0812 07:00:37.137714 (+ 2053us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:37.137732 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:37.139179 (+ 1447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:37.139940 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:37.139944 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:37.139972 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:37.141453 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:37.141468 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.144556 (+ 3088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.144561 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:37.148925 (+ 4364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:37.148941 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.152372 (+ 3431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.152381 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:37.152645 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.152684 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 07:00:37.152784 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 07:00:37.152923 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1863,"mutex_wait_us":1497}
I20260812 07:00:37.154956 11225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.136272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56798 (local address 127.18.70.129:46563)
0812 07:00:37.137314 (+ 1042us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:37.137323 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:37.139025 (+ 1702us) server_negotiation.cc:407] Connection header received
0812 07:00:37.139379 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:37.139388 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:37.139637 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:37.140646 (+ 1009us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:37.141986 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.144344 (+ 2358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.149154 (+ 4810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.151382 (+ 2228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.151529 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.152015 (+ 486us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:37.153950 (+ 1935us) server_negotiation.cc:299] Negotiation successful
0812 07:00:37.154158 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":831,"thread_start_us":597,"threads_started":1}
I20260812 07:00:37.159706 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 3dfeda98057e45af8bb91e3caa089946 (DEFAULT_TABLE table=test-table [id=5fcf87a769554e419193d4d4afe03d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:00:37.161607 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dfeda98057e45af8bb91e3caa089946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:37.164099 11222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.122728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:35027 (local address 127.0.0.1:55748)
0812 07:00:37.133250 (+ 10522us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:37.133270 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:37.133366 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:37.155689 (+ 22323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:37.155695 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:37.155723 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:37.155908 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:37.155921 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.158373 (+ 2452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.158378 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:37.160925 (+ 2547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:37.160942 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.163347 (+ 2405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.163354 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:37.163541 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.163574 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 07:00:37.163643 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 07:00:37.163778 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10426,"thread_start_us":12563,"threads_started":1}
I20260812 07:00:37.165649 11224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.123159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55748 (local address 127.18.70.131:35027)
0812 07:00:37.151337 (+ 28178us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:37.151346 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:37.151380 (+ 34us) server_negotiation.cc:407] Connection header received
0812 07:00:37.151473 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:37.151480 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:37.151708 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:37.156119 (+ 4411us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:37.156551 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.158222 (+ 1671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.161142 (+ 2920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.163163 (+ 2021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.164480 (+ 1317us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.164781 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:37.164861 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 07:00:37.165027 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27985,"thread_start_us":28689,"threads_started":1}
I20260812 07:00:37.170008 11074 tablet_service.cc:1467] Processing CreateTablet for tablet 3dfeda98057e45af8bb91e3caa089946 (DEFAULT_TABLE table=test-table [id=5fcf87a769554e419193d4d4afe03d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:00:37.171639 11074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dfeda98057e45af8bb91e3caa089946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:37.198699 11226 tablet_bootstrap.cc:492] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: Bootstrap starting.
I20260812 07:00:37.201963 11229 tablet_bootstrap.cc:492] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: Bootstrap starting.
I20260812 07:00:37.211145 11229 tablet_bootstrap.cc:654] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:37.211971 11228 tablet_bootstrap.cc:492] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: Bootstrap starting.
I20260812 07:00:37.214689 11228 tablet_bootstrap.cc:654] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:37.215667 11228 log.cc:824] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:37.217063 11229 log.cc:824] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:37.217374 11226 tablet_bootstrap.cc:654] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:37.218775 11226 log.cc:824] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:37.226239 11229 tablet_bootstrap.cc:492] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: No bootstrap required, opened a new log
I20260812 07:00:37.226575 11229 ts_tablet_manager.cc:1397] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.006s
I20260812 07:00:37.232810 11228 tablet_bootstrap.cc:492] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: No bootstrap required, opened a new log
I20260812 07:00:37.233079 11228 ts_tablet_manager.cc:1397] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
I20260812 07:00:37.242242 11226 tablet_bootstrap.cc:492] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: No bootstrap required, opened a new log
I20260812 07:00:37.242554 11226 ts_tablet_manager.cc:1397] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.006s
I20260812 07:00:37.243083 11228 raft_consensus.cc:348] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42529 } } peers { permanent_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35027 } } peers { permanent_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46563 } }
I20260812 07:00:37.243610 11228 raft_consensus.cc:374] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:37.243758 11228 raft_consensus.cc:729] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a590fe9e044ecb97b32abfb8d8bcbc, State: Initialized, Role: FOLLOWER
I20260812 07:00:37.244546 11228 consensus_queue.cc:260] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42529 } } peers { permanent_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35027 } } peers { permanent_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46563 } }
I20260812 07:00:37.251432 11181 heartbeater.cc:503] Master 127.18.70.190:46185 was elected leader, sending a full tablet report...
I20260812 07:00:37.254187 11229 raft_consensus.cc:348] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42529 } } peers { permanent_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35027 } } peers { permanent_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46563 } }
I20260812 07:00:37.254643 11229 raft_consensus.cc:374] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:37.254743 11229 raft_consensus.cc:729] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742b8241619e43a8bee0d1bfeecbf5a4, State: Initialized, Role: FOLLOWER
I20260812 07:00:37.255466 11229 consensus_queue.cc:260] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42529 } } peers { permanent_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35027 } } peers { permanent_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46563 } }
I20260812 07:00:37.257268 11228 ts_tablet_manager.cc:1428] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: Time spent starting tablet: real 0.024s user 0.014s sys 0.005s
I20260812 07:00:37.259526 11226 raft_consensus.cc:348] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42529 } } peers { permanent_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35027 } } peers { permanent_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46563 } }
I20260812 07:00:37.260016 11226 raft_consensus.cc:374] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:37.260290 11226 raft_consensus.cc:729] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cb02732a7d84ee0a4a2883a45de45ec, State: Initialized, Role: FOLLOWER
I20260812 07:00:37.261065 11226 consensus_queue.cc:260] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42529 } } peers { permanent_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35027 } } peers { permanent_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46563 } }
I20260812 07:00:37.263774 10724 heartbeater.cc:503] Master 127.18.70.190:46185 was elected leader, sending a full tablet report...
I20260812 07:00:37.264652 11229 ts_tablet_manager.cc:1428] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: Time spent starting tablet: real 0.038s user 0.012s sys 0.007s
I20260812 07:00:37.266439 10961 heartbeater.cc:503] Master 127.18.70.190:46185 was elected leader, sending a full tablet report...
I20260812 07:00:37.269505 11226 ts_tablet_manager.cc:1428] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: Time spent starting tablet: real 0.025s user 0.010s sys 0.008s
W20260812 07:00:37.331764 10726 tablet.cc:2369] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:00:37.451095 11187 tablet.cc:2369] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:00:37.486819 10962 tablet.cc:2369] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:00:37.648398 11242 raft_consensus.cc:482] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:00:37.648644 11242 raft_consensus.cc:504] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42529 } } peers { permanent_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35027 } } peers { permanent_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46563 } }
I20260812 07:00:37.650166 11242 leader_election.cc:288] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cb02732a7d84ee0a4a2883a45de45ec (127.18.70.130:42529), 742b8241619e43a8bee0d1bfeecbf5a4 (127.18.70.129:46563)
I20260812 07:00:37.657323 11262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.650570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:52157 (local address 127.18.70.130:42529)
0812 07:00:37.651491 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:37.651495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:37.651512 (+ 17us) server_negotiation.cc:407] Connection header received
0812 07:00:37.651572 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:37.651575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:37.651639 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:37.651732 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:37.652286 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.653051 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.655219 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.656440 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.656590 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.656664 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:37.656905 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 07:00:37.657045 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":814,"thread_start_us":697,"threads_started":1}
I20260812 07:00:37.657384 11261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.650440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:42529 (local address 127.18.70.131:52157)
0812 07:00:37.650911 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:37.650927 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:37.651040 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:37.651774 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:37.651779 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:37.651816 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:37.652141 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:37.652151 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.653179 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.653183 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:37.655056 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:37.655072 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.656590 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.656596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:37.656766 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.656790 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 07:00:37.656869 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 07:00:37.656994 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"spinlock_wait_cycles":45696,"thread_start_us":249,"threads_started":1}
I20260812 07:00:37.658103 11225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.651296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:48647 (local address 127.18.70.129:46563)
0812 07:00:37.651503 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:37.651511 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:37.651803 (+ 292us) server_negotiation.cc:407] Connection header received
0812 07:00:37.652052 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:37.652056 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:37.652125 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:37.652196 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:37.652711 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.653380 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.655687 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.656931 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.657089 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.657158 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:37.657702 (+ 544us) server_negotiation.cc:299] Negotiation successful
0812 07:00:37.657827 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 07:00:37.658182 11263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.651148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46563 (local address 127.18.70.131:48647)
0812 07:00:37.651710 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:37.651724 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:37.651909 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:37.652238 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:37.652242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:37.652265 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:37.652564 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:37.652573 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.653532 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.653535 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:37.655512 (+ 1977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:37.655527 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.657314 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.657321 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:37.657513 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.657547 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 07:00:37.657639 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 07:00:37.657762 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"spinlock_wait_cycles":51968,"thread_start_us":358,"threads_started":1}
I20260812 07:00:37.658684 10884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dfeda98057e45af8bb91e3caa089946" candidate_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" is_pre_election: true
I20260812 07:00:37.659237 10884 raft_consensus.cc:2454] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a590fe9e044ecb97b32abfb8d8bcbc in term 0.
I20260812 07:00:37.659179 10657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dfeda98057e45af8bb91e3caa089946" candidate_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" is_pre_election: true
I20260812 07:00:37.659729 10657 raft_consensus.cc:2454] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a590fe9e044ecb97b32abfb8d8bcbc in term 0.
I20260812 07:00:37.659955 11001 leader_election.cc:302] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cb02732a7d84ee0a4a2883a45de45ec, f3a590fe9e044ecb97b32abfb8d8bcbc; no voters:
I20260812 07:00:37.660341 11242 raft_consensus.cc:2781] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:00:37.660501 11242 raft_consensus.cc:482] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:00:37.660597 11242 raft_consensus.cc:3037] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:37.663708 11242 raft_consensus.cc:504] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42529 } } peers { permanent_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35027 } } peers { permanent_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46563 } }
I20260812 07:00:37.664386 11242 leader_election.cc:288] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [CANDIDATE]: Term 1 election: Requested vote from peers 6cb02732a7d84ee0a4a2883a45de45ec (127.18.70.130:42529), 742b8241619e43a8bee0d1bfeecbf5a4 (127.18.70.129:46563)
I20260812 07:00:37.664881 10657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dfeda98057e45af8bb91e3caa089946" candidate_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742b8241619e43a8bee0d1bfeecbf5a4"
I20260812 07:00:37.664884 10884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dfeda98057e45af8bb91e3caa089946" candidate_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cb02732a7d84ee0a4a2883a45de45ec"
I20260812 07:00:37.665094 10884 raft_consensus.cc:3037] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:37.665083 10657 raft_consensus.cc:3037] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:37.668044 10884 raft_consensus.cc:2454] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a590fe9e044ecb97b32abfb8d8bcbc in term 1.
I20260812 07:00:37.668480 10657 raft_consensus.cc:2454] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a590fe9e044ecb97b32abfb8d8bcbc in term 1.
I20260812 07:00:37.668483 11001 leader_election.cc:302] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cb02732a7d84ee0a4a2883a45de45ec, f3a590fe9e044ecb97b32abfb8d8bcbc; no voters:
I20260812 07:00:37.668737 11242 raft_consensus.cc:2781] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:00:37.669150 11242 raft_consensus.cc:686] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 1 LEADER]: Becoming Leader. State: Replica: f3a590fe9e044ecb97b32abfb8d8bcbc, State: Running, Role: LEADER
I20260812 07:00:37.669687 11242 consensus_queue.cc:237] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42529 } } peers { permanent_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35027 } } peers { permanent_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46563 } }
I20260812 07:00:37.674489 10410 catalog_manager.cc:5495] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a590fe9e044ecb97b32abfb8d8bcbc (127.18.70.131). New cstate: current_term: 1 leader_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a590fe9e044ecb97b32abfb8d8bcbc" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46563 } health_report { overall_health: UNKNOWN } } }
I20260812 07:00:37.816290 11275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.811100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55752 (local address 127.18.70.131:35027)
0812 07:00:37.811777 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:37.811781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:37.811796 (+ 15us) server_negotiation.cc:407] Connection header received
0812 07:00:37.811875 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:37.811879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:37.811958 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:37.812092 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:00:37.812401 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.813067 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.814493 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.814882 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.814969 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.815363 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:00:37.815835 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:00:37.815933 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:37.815997 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 07:00:37.816069 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":481,"threads_started":1}
I20260812 07:00:37.823635 10884 raft_consensus.cc:1261] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec [term 1 FOLLOWER]: Refusing update from remote peer f3a590fe9e044ecb97b32abfb8d8bcbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:00:37.823637 10657 raft_consensus.cc:1261] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4 [term 1 FOLLOWER]: Refusing update from remote peer f3a590fe9e044ecb97b32abfb8d8bcbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:00:37.824445 11265 consensus_queue.cc:1035] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "742b8241619e43a8bee0d1bfeecbf5a4" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:00:37.824777 11242 consensus_queue.cc:1035] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cb02732a7d84ee0a4a2883a45de45ec" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 42529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:00:37.855212 10410 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:00:37.855499 10410 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:00:37.860098 10410 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3cdcbf770ad449b995d907f5bc13c3b: Sending DeleteTablet for 3 replicas of tablet 3dfeda98057e45af8bb91e3caa089946
I20260812 07:00:37.861474 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dfeda98057e45af8bb91e3caa089946 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:00:37 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:56798
I20260812 07:00:37.861631 10848 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dfeda98057e45af8bb91e3caa089946 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:00:37 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:51368
I20260812 07:00:37.862449 11074 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dfeda98057e45af8bb91e3caa089946 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:00:37 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:55748
I20260812 07:00:37.863219 11297 tablet_replica.cc:330] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: stopping tablet replica
I20260812 07:00:37.863667 11297 raft_consensus.cc:2229] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:00:37.864311 11297 raft_consensus.cc:2258] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:00:37.865577 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 10475
I20260812 07:00:37.866555 11297 ts_tablet_manager.cc:1905] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:00:37.900023 11299 tablet_replica.cc:330] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: stopping tablet replica
I20260812 07:00:37.903394 11299 raft_consensus.cc:2229] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:00:37.905331 11297 ts_tablet_manager.cc:1918] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:00:37.907617 11297 log.cc:1196] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/3dfeda98057e45af8bb91e3caa089946
I20260812 07:00:37.908906 11299 raft_consensus.cc:2258] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:00:37.909024 11297 ts_tablet_manager.cc:1939] T 3dfeda98057e45af8bb91e3caa089946 P 742b8241619e43a8bee0d1bfeecbf5a4: Deleting consensus metadata
I20260812 07:00:37.910305 11301 tablet_replica.cc:330] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: stopping tablet replica
I20260812 07:00:37.910759 11301 raft_consensus.cc:2229] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 1 LEADER]: Raft consensus shutting down.
I20260812 07:00:37.911566 11299 ts_tablet_manager.cc:1905] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:00:37.916389 10387 catalog_manager.cc:4841] TS 742b8241619e43a8bee0d1bfeecbf5a4 (127.18.70.129:46563): tablet 3dfeda98057e45af8bb91e3caa089946 (table test-table [id=5fcf87a769554e419193d4d4afe03d62]) successfully deleted
I20260812 07:00:37.918644 11301 raft_consensus.cc:2258] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:00:37.920733 11299 ts_tablet_manager.cc:1918] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:00:37.920885 11299 log.cc:1196] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/3dfeda98057e45af8bb91e3caa089946
I20260812 07:00:37.921459 11299 ts_tablet_manager.cc:1939] T 3dfeda98057e45af8bb91e3caa089946 P 6cb02732a7d84ee0a4a2883a45de45ec: Deleting consensus metadata
I20260812 07:00:37.922276 11301 ts_tablet_manager.cc:1905] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:00:37.923185 10387 catalog_manager.cc:4841] TS 6cb02732a7d84ee0a4a2883a45de45ec (127.18.70.130:42529): tablet 3dfeda98057e45af8bb91e3caa089946 (table test-table [id=5fcf87a769554e419193d4d4afe03d62]) successfully deleted
I20260812 07:00:37.928179 11225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:37.867387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56800 (local address 127.18.70.129:46563)
0812 07:00:37.867569 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:37.867575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:37.898644 (+ 31069us) server_negotiation.cc:407] Connection header received
0812 07:00:37.898816 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:37.898821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:37.898898 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:37.898987 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:37.902588 (+ 3601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.904854 (+ 2266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.909375 (+ 4521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:37.913751 (+ 4376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:37.913886 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:37.920178 (+ 6292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:37.920194 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:37.920211 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:37.920288 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:37.924762 (+ 4474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:37.925570 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:37.925579 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:37.925583 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:37.925749 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:37.926238 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:37.926244 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:37.926247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:37.926708 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:37.927050 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:37.927384 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 07:00:37.927597 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 07:00:37.928835 10714 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:37.930342 11301 ts_tablet_manager.cc:1918] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:00:37.930598 11301 log.cc:1196] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/3dfeda98057e45af8bb91e3caa089946
I20260812 07:00:37.931187 11301 ts_tablet_manager.cc:1939] T 3dfeda98057e45af8bb91e3caa089946 P f3a590fe9e044ecb97b32abfb8d8bcbc: Deleting consensus metadata
I20260812 07:00:37.932739 10387 catalog_manager.cc:4841] TS f3a590fe9e044ecb97b32abfb8d8bcbc (127.18.70.131:35027): tablet 3dfeda98057e45af8bb91e3caa089946 (table test-table [id=5fcf87a769554e419193d4d4afe03d62]) successfully deleted
I20260812 07:00:38.077219 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 10475
I20260812 07:00:38.096838 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 10729
I20260812 07:00:38.110307 11262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:38.097651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51384 (local address 127.18.70.130:42529)
0812 07:00:38.097864 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:38.097870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:38.097908 (+ 38us) server_negotiation.cc:407] Connection header received
0812 07:00:38.097981 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:38.097985 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:38.098049 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:38.098132 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:38.099480 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:38.100226 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:38.101512 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:38.101940 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:38.102063 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:38.104456 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:38.104471 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:38.104488 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:38.104527 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:38.107419 (+ 2892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:38.108171 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:38.108179 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:38.108182 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:38.108322 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:38.108728 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:38.108733 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:38.108736 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:38.109095 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:38.109368 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:38.109720 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 07:00:38.109976 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 07:00:38.110949 10949 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:38.211833 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 10729
I20260812 07:00:38.235788 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 10967
I20260812 07:00:38.249738 11275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:38.236531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55768 (local address 127.18.70.131:35027)
0812 07:00:38.237025 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:38.237029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:38.237044 (+ 15us) server_negotiation.cc:407] Connection header received
0812 07:00:38.237095 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:38.237099 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:38.237158 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:38.237240 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:38.238693 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:38.239458 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:38.240883 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:38.241355 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:38.241468 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:38.243960 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:38.243985 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:38.244003 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:38.244042 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:38.247018 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:38.247689 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:38.247696 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:38.247699 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:38.247827 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:38.248172 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:38.248179 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:38.248181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:38.248573 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:38.248890 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:38.249158 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 07:00:38.249428 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370}
I20260812 07:00:38.250388 11176 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:38.371047 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 10967
I20260812 07:00:38.396284 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 10346
I20260812 07:00:38.397428 10457 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:38.506492 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 10346
I20260812 07:00:38.542691 18714 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 07:00:38.886330 18714 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 07:00:38.886528 18714 mini_ranger.cc:66] Stopping Ranger...
I20260812 07:00:39.230125 18714 mini_ranger.cc:68] Stopped Ranger
2026-08-12 07:00:39.230 UTC [8720] LOG: received smart shutdown request
2026-08-12 07:00:39.232 UTC [8720] LOG: background worker "logical replication launcher" (PID 8737) exited with exit code 1
2026-08-12 07:00:39.233 UTC [8726] LOG: shutting down
2026-08-12 07:00:39.365 UTC [8720] LOG: database system is shut down
2026-08-12T07:00:39Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (53771 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:00:39 dist-test-slave-tc2s krb5kdc[11323](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:00:39 dist-test-slave-tc2s krb5kdc[11323](info): set up 2 sockets
Aug 12 07:00:39 dist-test-slave-tc2s krb5kdc[11323](info): commencing operation
krb5kdc: starting...
W20260812 07:00:40.743798 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.005s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:00:40 dist-test-slave-tc2s krb5kdc[11323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:00:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:00:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:00:40.948797 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43853
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:35867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:43853,127.18.70.189:33675,127.18.70.188:39397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:00:41.272891 11345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:41.273136 11345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:41.273227 11345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:41.280061 11345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:00:41.280151 11345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:41.280202 11345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:41.280256 11345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:00:41.280311 11345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:00:41.289477 11345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:35867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:43853,127.18.70.189:33675,127.18.70.188:39397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:41.290606 11345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:41.291711 11345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:41.302488 11358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:41.302562 11362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:41.302512 11360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:41.303360 11345 server_base.cc:1034] running on GCE node
I20260812 07:00:41.304145 11345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:41.305356 11345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:41.306545 11345 hybrid_clock.cc:648] HybridClock initialized: now 1786518041306492 us; error 44 us; skew 500 ppm
I20260812 07:00:41.306844 11345 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:41 dist-test-slave-tc2s krb5kdc[11323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518041, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:41.313292 11345 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:00:41.314612 11345 webserver.cc:460] Webserver started at http://127.18.70.190:40643/ using document root <none> and password file <none>
I20260812 07:00:41.315212 11345 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:41.315323 11345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:41.315595 11345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:00:41.318349 11345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "e2b20472a17c40e39398d2b9a62add24"
format_stamp: "Formatted at 2026-08-12 07:00:41 on dist-test-slave-tc2s"
server_key: "1a9d0923ad1a0fbc31300379aa4c0a16"
server_key_iv: "7de5016f4439d1c3a2150b7df5271d06"
server_key_version: "encryptionkey@0"
I20260812 07:00:41.319096 11345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "e2b20472a17c40e39398d2b9a62add24"
format_stamp: "Formatted at 2026-08-12 07:00:41 on dist-test-slave-tc2s"
server_key: "1a9d0923ad1a0fbc31300379aa4c0a16"
server_key_iv: "7de5016f4439d1c3a2150b7df5271d06"
server_key_version: "encryptionkey@0"
I20260812 07:00:41.323686 11345 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 07:00:41.326783 11371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:41.327888 11345 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 07:00:41.328049 11345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "e2b20472a17c40e39398d2b9a62add24"
format_stamp: "Formatted at 2026-08-12 07:00:41 on dist-test-slave-tc2s"
server_key: "1a9d0923ad1a0fbc31300379aa4c0a16"
server_key_iv: "7de5016f4439d1c3a2150b7df5271d06"
server_key_version: "encryptionkey@0"
I20260812 07:00:41.328220 11345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:41.352113 11345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:41.355466 11345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:41.355710 11345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:41.372174 11345 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:43853
I20260812 07:00:41.372217 11445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:43853 every 8 connection(s)
I20260812 07:00:41.373327 11345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:00:41.375870 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 11345
I20260812 07:00:41.376067 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:00:41.376672 11447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:41.376677 18714 external_mini_cluster.cc:1428] Setting key 30b72309873025961b1a29538066203c
I20260812 07:00:41.382835 11447 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:00:41 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518041, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.70.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.189@KRBTEST.COM" created.
I20260812 07:00:41.403535 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.385649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43853 (local address 127.0.0.1:55596)
0812 07:00:41.386513 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.386558 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:41.388834 (+ 2276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:41.389861 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:41.389867 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:41.390583 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:41.390876 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:41.390892 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.392346 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.392350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:41.393377 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:41.393390 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.394288 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.394296 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:41.394451 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:41.395020 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:41.395041 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:41.397055 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:41.400053 (+ 2998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:41.400062 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:41.400069 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:41.400474 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:41.400830 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:41.400833 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:41.400836 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:41.400978 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:41.401785 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:41.401792 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:41.402057 (+ 265us) client_negotiation.cc:769] Sending connection context
0812 07:00:41.402252 (+ 195us) client_negotiation.cc:240] Negotiation successful
0812 07:00:41.402577 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":366,"threads_started":1}
I20260812 07:00:41.403561 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.385649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55596 (local address 127.18.70.190:43853)
0812 07:00:41.387308 (+ 1659us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:41.387314 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:41.387354 (+ 40us) server_negotiation.cc:407] Connection header received
0812 07:00:41.389313 (+ 1959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:41.389324 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:41.389624 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:41.389817 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:41.391075 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.392207 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.393512 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.394069 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.394232 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:41.397256 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:41.397263 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:41.397273 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:41.397300 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:41.399914 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:41.400593 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:41.400599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:41.400601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:41.400740 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:41.401054 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:41.401058 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:41.401061 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:41.401619 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:41.401781 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:41.402420 (+ 639us) server_negotiation.cc:299] Negotiation successful
0812 07:00:41.402747 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":1487,"spinlock_wait_cycles":15744,"thread_start_us":1262,"threads_started":1}
I20260812 07:00:41.407226 11447 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } has no permanent_uuid. Determining permanent_uuid...
I20260812 07:00:41.408393 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.407940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48788)
0812 07:00:41.408157 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.408274 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 07:00:41.408751 11377 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
I20260812 07:00:41.410348 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.410036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48796)
0812 07:00:41.410162 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.410238 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 07:00:41.410518 11447 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:33675: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab.
Entry for principal kudu/127.18.70.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab.
I20260812 07:00:41.428849 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.189:33675
--webserver_interface=127.18.70.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab
--principal=kudu/127.18.70.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:35867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:43853,127.18.70.189:33675,127.18.70.188:39397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:00:41.459812 11447 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } attempt: 1
I20260812 07:00:41.460889 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.460414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48804)
0812 07:00:41.460605 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.460727 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 07:00:41.461835 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.461456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48818)
0812 07:00:41.461593 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.461675 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 07:00:41.462034 11447 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:33675: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
I20260812 07:00:41.530270 11447 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } attempt: 2
I20260812 07:00:41.531486 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.530934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48830)
0812 07:00:41.531207 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.531317 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 07:00:41.532477 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.532095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48834)
0812 07:00:41.532232 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.532329 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 07:00:41.532680 11447 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:33675: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
I20260812 07:00:41.623956 11447 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } attempt: 3
I20260812 07:00:41.625205 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.624663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48848)
0812 07:00:41.624904 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.625025 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 07:00:41.626309 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.625836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48850)
0812 07:00:41.626027 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.626136 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260812 07:00:41.626515 11447 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:33675: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
W20260812 07:00:41.741119 11455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:41.741359 11455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:41.741457 11455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:41.748291 11455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:00:41.748382 11455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:41.748435 11455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:41.748487 11455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:00:41.748528 11455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:00:41.757597 11455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:35867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:43853,127.18.70.189:33675,127.18.70.188:39397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab
--principal=kudu/127.18.70.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.189:33675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.70.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:41.758643 11455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:41.759780 11455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 07:00:41.769755 11447 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } attempt: 4
W20260812 07:00:41.770352 11470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:41.770634 11475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:41.770937 11478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:41.771112 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.770423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48862)
0812 07:00:41.770845 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.770967 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":298}
I20260812 07:00:41.771616 11455 server_base.cc:1034] running on GCE node
I20260812 07:00:41.772127 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.771701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48874)
0812 07:00:41.771864 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.771978 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 07:00:41.772354 11447 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:33675: Network error: Client connection negotiation failed: client connection to 127.18.70.189:33675: connect: Connection refused (error 111)
I20260812 07:00:41.772495 11455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:41.773692 11455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:41.774884 11455 hybrid_clock.cc:648] HybridClock initialized: now 1786518041774846 us; error 25 us; skew 500 ppm
I20260812 07:00:41.775192 11455 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:41 dist-test-slave-tc2s krb5kdc[11323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518041, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:41.778020 11455 init.cc:377] Logged in from keytab as kudu/127.18.70.189@KRBTEST.COM (short username kudu)
I20260812 07:00:41.779340 11455 webserver.cc:460] Webserver started at http://127.18.70.189:38225/ using document root <none> and password file <none>
I20260812 07:00:41.779935 11455 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:41.780047 11455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:41.780330 11455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:00:41.783048 11455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/data/instance:
uuid: "2f5dda69e04d4acab126fa9d9831d04a"
format_stamp: "Formatted at 2026-08-12 07:00:41 on dist-test-slave-tc2s"
server_key: "02892e51573426381f4ca040a9e22559"
server_key_iv: "4ad303a15ce7a64d47580027dda03a48"
server_key_version: "encryptionkey@0"
I20260812 07:00:41.783769 11455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/wal/instance:
uuid: "2f5dda69e04d4acab126fa9d9831d04a"
format_stamp: "Formatted at 2026-08-12 07:00:41 on dist-test-slave-tc2s"
server_key: "02892e51573426381f4ca040a9e22559"
server_key_iv: "4ad303a15ce7a64d47580027dda03a48"
server_key_version: "encryptionkey@0"
I20260812 07:00:41.788326 11455 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 07:00:41.791436 11497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:41.792562 11455 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 07:00:41.792703 11455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/wal
uuid: "2f5dda69e04d4acab126fa9d9831d04a"
format_stamp: "Formatted at 2026-08-12 07:00:41 on dist-test-slave-tc2s"
server_key: "02892e51573426381f4ca040a9e22559"
server_key_iv: "4ad303a15ce7a64d47580027dda03a48"
server_key_version: "encryptionkey@0"
I20260812 07:00:41.792873 11455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:41.821753 11455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:41.825121 11455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:41.825356 11455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:41.842087 11455 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.189:33675
I20260812 07:00:41.842127 11580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.189:33675 every 8 connection(s)
I20260812 07:00:41.843230 11455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
I20260812 07:00:41.846099 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 11455
I20260812 07:00:41.846297 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-1/wal/instance
I20260812 07:00:41.846819 11581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:41.846832 18714 external_mini_cluster.cc:1428] Setting key 28a3047b7d1e0c1235668a6a83c80f73
I20260812 07:00:41.854923 11581 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:00:41 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518041, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.70.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.188@KRBTEST.COM" created.
I20260812 07:00:41.874078 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.857624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55602 (local address 127.18.70.190:43853)
0812 07:00:41.857812 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:41.857816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:41.859047 (+ 1231us) server_negotiation.cc:407] Connection header received
0812 07:00:41.860800 (+ 1753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:41.860806 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:41.860882 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:41.860977 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:41.862383 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.863050 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.864482 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.864889 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.865007 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:41.868360 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:41.868365 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:41.868368 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:41.868400 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:41.870933 (+ 2533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:41.871711 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:41.871715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:41.871717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:41.871836 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:41.872270 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:41.872275 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:41.872278 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:41.872577 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:41.872730 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:41.873544 (+ 814us) server_negotiation.cc:299] Negotiation successful
0812 07:00:41.873767 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 07:00:41.874802 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.858208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43853 (local address 127.0.0.1:55602)
0812 07:00:41.858902 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.858944 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:41.860548 (+ 1604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:41.861188 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:41.861196 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:41.861665 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:41.862218 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:41.862234 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.863196 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.863201 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:41.864341 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:41.864353 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.865093 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.865100 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:41.865299 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:41.865868 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:41.865918 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:41.868161 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:41.871060 (+ 2899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:41.871069 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:41.871082 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:41.871593 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:41.871938 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:41.871943 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:41.871947 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:41.872122 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:41.872728 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:41.872735 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:41.873123 (+ 388us) client_negotiation.cc:769] Sending connection context
0812 07:00:41.873414 (+ 291us) client_negotiation.cc:240] Negotiation successful
0812 07:00:41.873792 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":292,"threads_started":1}
I20260812 07:00:41.876287 11581 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:00:41 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518041, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
I20260812 07:00:41.888535 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.876949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48884)
0812 07:00:41.877110 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.877127 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:41.877232 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:41.877848 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:41.877852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:41.878241 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:41.878367 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:41.878374 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.879619 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.879624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:41.880422 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:41.880433 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.881164 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.881170 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:41.881352 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:41.881793 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:41.881808 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:41.883587 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:41.886353 (+ 2766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:41.886358 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:41.886362 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:41.886696 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:41.887021 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:41.887026 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:41.887030 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:41.887168 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:41.887689 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:41.887694 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:41.887818 (+ 124us) client_negotiation.cc:769] Sending connection context
0812 07:00:41.887928 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 07:00:41.888168 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 07:00:41.888765 11586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.877010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48884 (local address 127.18.70.189:33675)
0812 07:00:41.877506 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:41.877511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:41.877533 (+ 22us) server_negotiation.cc:407] Connection header received
0812 07:00:41.877569 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:41.877574 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:41.877713 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:41.877837 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:41.878519 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.879491 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.880551 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:41.881037 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:41.881140 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:41.883766 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:41.883775 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:41.883786 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:41.883811 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:41.886245 (+ 2434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:41.886806 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:41.886811 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:41.886813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:41.886914 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:41.887261 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:41.887266 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:41.887269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:41.887570 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:41.887750 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:41.888073 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 07:00:41.888274 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":224,"threads_started":1}
I20260812 07:00:41.890959 11581 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } has no permanent_uuid. Determining permanent_uuid...
I20260812 07:00:41.891978 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.891582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58476)
0812 07:00:41.891717 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.891836 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 07:00:41.892302 11498 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
I20260812 07:00:41.893667 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.893350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58486)
0812 07:00:41.893480 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.893552 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 07:00:41.893873 11581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:39397: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab.
Entry for principal kudu/127.18.70.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab.
I20260812 07:00:41.898860 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.188:39397
--webserver_interface=127.18.70.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab
--principal=kudu/127.18.70.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:35867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:43853,127.18.70.189:33675,127.18.70.188:39397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:00:41.943221 11581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } attempt: 1
I20260812 07:00:41.944236 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.943848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58498)
0812 07:00:41.944019 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.944108 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 07:00:41.945185 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:41.944886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58506)
0812 07:00:41.945021 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:41.945087 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 07:00:41.945399 11581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:39397: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
I20260812 07:00:42.013594 11581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } attempt: 2
I20260812 07:00:42.014719 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.014305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58522)
0812 07:00:42.014486 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.014573 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 07:00:42.015591 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.015306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58530)
0812 07:00:42.015417 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.015483 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260812 07:00:42.015800 11581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:39397: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
I20260812 07:00:42.071596 11447 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } attempt: 5
Aug 12 07:00:42 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518041, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
I20260812 07:00:42.085266 11586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.072399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48898 (local address 127.18.70.189:33675)
0812 07:00:42.072563 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.072567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.072586 (+ 19us) server_negotiation.cc:407] Connection header received
0812 07:00:42.072765 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.072769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.072855 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.072936 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.074040 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.074727 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.076401 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.076850 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.076939 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.080406 (+ 3467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.080412 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.080415 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.080448 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.082863 (+ 2415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.083463 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.083467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.083470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.083593 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.084032 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.084035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.084037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.084309 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.084416 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.084887 (+ 471us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.085056 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 07:00:42.085475 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.072228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48898)
0812 07:00:42.072460 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.072493 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:42.072641 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:42.073007 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:42.073013 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:42.073585 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:42.073837 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.073852 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.074869 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.074876 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.076273 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.076291 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.077019 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.077026 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.077220 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.077813 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:42.077837 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:42.080209 (+ 2372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:42.082989 (+ 2780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.082995 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.082999 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.083353 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.083733 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.083739 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.083742 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.083928 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.084424 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:42.084429 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:42.084614 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 07:00:42.084813 (+ 199us) client_negotiation.cc:240] Negotiation successful
0812 07:00:42.085103 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 07:00:42.086501 11447 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } has no permanent_uuid. Determining permanent_uuid...
I20260812 07:00:42.087570 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.087101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58532)
0812 07:00:42.087285 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.087385 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 07:00:42.088450 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.088150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58548)
0812 07:00:42.088274 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.088349 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 07:00:42.088667 11447 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:39397: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
I20260812 07:00:42.106980 11581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } attempt: 3
I20260812 07:00:42.107813 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.107415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58560)
0812 07:00:42.107605 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.107679 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 07:00:42.108843 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.108435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58564)
0812 07:00:42.108658 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.108734 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
W20260812 07:00:42.109066 11581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:39397: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
I20260812 07:00:42.139858 11447 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } attempt: 1
I20260812 07:00:42.140799 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.140415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58578)
0812 07:00:42.140567 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.140642 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 07:00:42.141697 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.141401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58590)
0812 07:00:42.141525 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.141599 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 07:00:42.141912 11447 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:39397: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
I20260812 07:00:42.210101 11447 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } attempt: 2
I20260812 07:00:42.211205 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.210747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58598)
0812 07:00:42.210962 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.211060 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 07:00:42.212141 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.211836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58614)
0812 07:00:42.211961 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.212033 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 07:00:42.212335 11447 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:39397: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
W20260812 07:00:42.220451 11590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:42.220700 11590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:42.220829 11590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:42.227728 11590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:00:42.227819 11590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:42.227895 11590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:42.227970 11590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:00:42.228026 11590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:00:42.237435 11590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:35867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:43853,127.18.70.189:33675,127.18.70.188:39397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab
--principal=kudu/127.18.70.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.188:39397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.70.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:42.238623 11590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:42.239806 11590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:42.251130 11597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:42.251154 11598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:42.251123 11603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:42.251796 11590 server_base.cc:1034] running on GCE node
I20260812 07:00:42.252246 11581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } attempt: 4
I20260812 07:00:42.252588 11590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:42.253202 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.252769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58620)
0812 07:00:42.252979 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.253059 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 07:00:42.253829 11590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:42.254240 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.253793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58626)
0812 07:00:42.254039 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.254118 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
W20260812 07:00:42.254467 11581 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:39397: Network error: Client connection negotiation failed: client connection to 127.18.70.188:39397: connect: Connection refused (error 111)
I20260812 07:00:42.255043 11590 hybrid_clock.cc:648] HybridClock initialized: now 1786518042254982 us; error 54 us; skew 500 ppm
I20260812 07:00:42.255347 11590 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:42 dist-test-slave-tc2s krb5kdc[11323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518042, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:42.258209 11590 init.cc:377] Logged in from keytab as kudu/127.18.70.188@KRBTEST.COM (short username kudu)
I20260812 07:00:42.259482 11590 webserver.cc:460] Webserver started at http://127.18.70.188:35775/ using document root <none> and password file <none>
I20260812 07:00:42.260095 11590 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:42.260207 11590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:42.260481 11590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:00:42.263382 11590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/data/instance:
uuid: "d6387b4d87cf493c88f3a4d450ab8c62"
format_stamp: "Formatted at 2026-08-12 07:00:42 on dist-test-slave-tc2s"
server_key: "e18f0f5cb544b8a925ad5cec3d2626d6"
server_key_iv: "af7d5a43805c71110106761495c49b41"
server_key_version: "encryptionkey@0"
I20260812 07:00:42.264148 11590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/wal/instance:
uuid: "d6387b4d87cf493c88f3a4d450ab8c62"
format_stamp: "Formatted at 2026-08-12 07:00:42 on dist-test-slave-tc2s"
server_key: "e18f0f5cb544b8a925ad5cec3d2626d6"
server_key_iv: "af7d5a43805c71110106761495c49b41"
server_key_version: "encryptionkey@0"
I20260812 07:00:42.268893 11590 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260812 07:00:42.271977 11611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:42.273077 11590 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 07:00:42.273226 11590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/wal
uuid: "d6387b4d87cf493c88f3a4d450ab8c62"
format_stamp: "Formatted at 2026-08-12 07:00:42 on dist-test-slave-tc2s"
server_key: "e18f0f5cb544b8a925ad5cec3d2626d6"
server_key_iv: "af7d5a43805c71110106761495c49b41"
server_key_version: "encryptionkey@0"
I20260812 07:00:42.273398 11590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:42.288447 11590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:42.292196 11590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:42.292426 11590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:42.308920 11590 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.188:39397
I20260812 07:00:42.308962 11705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.188:39397 every 8 connection(s)
I20260812 07:00:42.310142 11590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
I20260812 07:00:42.313392 11708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:42.316463 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 11590
I20260812 07:00:42.316650 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786517832212618-18714-0/minicluster-data/master-2/wal/instance
I20260812 07:00:42.317102 18714 external_mini_cluster.cc:1428] Setting key cba525769f6e92830f8776c6170c0cfc
I20260812 07:00:42.318537 11447 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } attempt: 3
I20260812 07:00:42.320385 11708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:00:42 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518041, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
Aug 12 07:00:42 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
Aug 12 07:00:42 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518042, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:42.339396 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.319109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58648)
0812 07:00:42.319374 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.319392 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:42.319499 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:42.323126 (+ 3627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:42.323132 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:42.323630 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:42.323859 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.323876 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.326327 (+ 2451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.326333 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.327547 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.327565 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.328717 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.328723 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.328895 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.329632 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:42.329656 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:42.332194 (+ 2538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:42.336260 (+ 4066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.336267 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.336271 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.336817 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.337307 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.337312 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.337316 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.337481 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.338333 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:42.338338 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:42.338524 (+ 186us) client_negotiation.cc:769] Sending connection context
0812 07:00:42.338769 (+ 245us) client_negotiation.cc:240] Negotiation successful
0812 07:00:42.339016 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148}
I20260812 07:00:42.340437 11717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.319220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58648 (local address 127.18.70.188:39397)
0812 07:00:42.320305 (+ 1085us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.320311 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.320332 (+ 21us) server_negotiation.cc:407] Connection header received
0812 07:00:42.322279 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.322304 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.322743 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.323127 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.324110 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.326165 (+ 2055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.327692 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.328539 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.329191 (+ 652us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.332430 (+ 3239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.332440 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.332451 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.332485 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.336127 (+ 3642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.336953 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.336959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.336965 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.337168 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.337609 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.337615 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.337617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.338208 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.338390 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.338973 (+ 583us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.339333 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":425,"server-negotiator.queue_time_us":942,"spinlock_wait_cycles":5248,"thread_start_us":792,"threads_started":1}
I20260812 07:00:42.340873 11716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.318761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58636 (local address 127.18.70.188:39397)
0812 07:00:42.320064 (+ 1303us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.320082 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.320135 (+ 53us) server_negotiation.cc:407] Connection header received
0812 07:00:42.322276 (+ 2141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.322305 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.322743 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.323127 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.325015 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.326169 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.327720 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.328534 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.328695 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.333420 (+ 4725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.333427 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.333432 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.333472 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.336922 (+ 3450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.337639 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.337643 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.337646 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.337786 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.338268 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.338272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.338276 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.338579 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.338808 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.340053 (+ 1245us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.340245 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":1052,"spinlock_wait_cycles":27008,"thread_start_us":843,"threads_started":1}
I20260812 07:00:42.340901 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.324095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55610 (local address 127.18.70.190:43853)
0812 07:00:42.324261 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.324267 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.324986 (+ 719us) server_negotiation.cc:407] Connection header received
0812 07:00:42.325286 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.325292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.325379 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.325477 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.326939 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.327932 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.329726 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.330484 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.330617 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.334484 (+ 3867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.334490 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.334495 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.334533 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.337845 (+ 3312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.338692 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.338697 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.338700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.338873 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.339290 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.339295 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.339298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.339623 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.339747 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.340406 (+ 659us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.340599 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 07:00:42.341779 11718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.324017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43853 (local address 127.0.0.1:55610)
0812 07:00:42.324863 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.324906 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:42.325139 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:42.325566 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:42.325573 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:42.326458 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:42.326776 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.326788 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.328100 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.328105 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.329572 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.329586 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.330731 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.330739 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.330904 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.331466 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:42.331485 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:42.334278 (+ 2793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:42.338025 (+ 3747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.338035 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.338042 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.338573 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.338978 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.338983 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.338986 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.339151 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.339876 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:42.339882 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:42.340071 (+ 189us) client_negotiation.cc:769] Sending connection context
0812 07:00:42.341110 (+ 1039us) client_negotiation.cc:240] Negotiation successful
0812 07:00:42.341390 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":467,"threads_started":1}
I20260812 07:00:42.343021 11708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } has no permanent_uuid. Determining permanent_uuid...
I20260812 07:00:42.347456 11447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24: Bootstrap starting.
I20260812 07:00:42.351078 11447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24: Neither blocks nor log segments found. Creating new log.
Aug 12 07:00:42 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518042, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
Aug 12 07:00:42 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:42.352044 11447 log.cc:824] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:42.355104 11447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24: No bootstrap required, opened a new log
I20260812 07:00:42.357846 11718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.343714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:33675 (local address 127.0.0.1:48902)
0812 07:00:42.343880 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.343897 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:42.343972 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:42.344540 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:42.344545 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:42.344949 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:42.345105 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.345116 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.346436 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.346441 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.347751 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.347768 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.348801 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.348807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.348991 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.349456 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:42.349476 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:42.351867 (+ 2391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:42.355386 (+ 3519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.355391 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.355395 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.355911 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.356279 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.356284 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.356287 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.356459 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.357010 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:42.357015 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:42.357151 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 07:00:42.357269 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 07:00:42.357515 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 07:00:42.357933 11586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.344088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48902 (local address 127.18.70.189:33675)
0812 07:00:42.344250 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.344255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.344273 (+ 18us) server_negotiation.cc:407] Connection header received
0812 07:00:42.344326 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.344330 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.344396 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.344488 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.345268 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.346297 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.347911 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.348492 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.348618 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.352107 (+ 3489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.352113 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.352118 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.352157 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.355241 (+ 3084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.356033 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.356038 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.356042 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.356172 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.356587 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.356592 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.356596 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.356901 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.357043 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.357370 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.357562 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 07:00:42.358657 11708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } has no permanent_uuid. Determining permanent_uuid...
I20260812 07:00:42.359879 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.343426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55626 (local address 127.18.70.190:43853)
0812 07:00:42.343568 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.343573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.343589 (+ 16us) server_negotiation.cc:407] Connection header received
0812 07:00:42.343748 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.343753 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.343828 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.343912 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.345420 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.346227 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.348029 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.348462 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.348565 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.352845 (+ 4280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.352851 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.352855 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.352889 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.355923 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.356844 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.356849 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.356853 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.357012 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.357465 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.357471 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.357474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.358313 (+ 839us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.358589 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.359339 (+ 750us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.359563 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 07:00:42.365020 11447 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } }
I20260812 07:00:42.365331 11447 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:42.365453 11447 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b20472a17c40e39398d2b9a62add24, State: Initialized, Role: FOLLOWER
I20260812 07:00:42.366019 11447 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } }
Aug 12 07:00:42 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518042, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
I20260812 07:00:42.366954 11721 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } } }
I20260812 07:00:42.367434 11721 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:00:42.368180 11447 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:00:42.372642 11716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.359251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58660 (local address 127.18.70.188:39397)
0812 07:00:42.360180 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.360185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.360202 (+ 17us) server_negotiation.cc:407] Connection header received
0812 07:00:42.360244 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.360249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.360329 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.360421 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.361011 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.361844 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.363446 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.363844 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.363944 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.367182 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.367188 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.367192 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.367225 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.369974 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.370707 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.370712 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.370715 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.370875 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.371227 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.371232 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.371236 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.371498 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.371626 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.372164 (+ 538us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.372356 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":824}
Aug 12 07:00:42 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
I20260812 07:00:42.373591 11718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.359219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58660)
0812 07:00:42.359349 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.359365 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:42.359442 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:42.360446 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:42.360449 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:42.360748 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:42.360877 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.360885 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.362063 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.362068 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.363335 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.363346 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.363965 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.363971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.364156 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.364592 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:42.364607 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:42.367004 (+ 2397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:42.370109 (+ 3105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.370114 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.370117 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.370590 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.371004 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.371008 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.371011 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.371130 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.371678 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:42.371682 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:42.371909 (+ 227us) client_negotiation.cc:769] Sending connection context
0812 07:00:42.372960 (+ 1051us) client_negotiation.cc:240] Negotiation successful
0812 07:00:42.373291 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 07:00:42.381477 11586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.362798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48908 (local address 127.18.70.189:33675)
0812 07:00:42.362939 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.362943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.362959 (+ 16us) server_negotiation.cc:407] Connection header received
0812 07:00:42.363009 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.363014 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.363072 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.363160 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.364708 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.366088 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.367927 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.368538 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.368635 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.374754 (+ 6119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.374760 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.374765 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.374798 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.377950 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.378805 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.378810 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.378814 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.378962 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.379386 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.379391 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.379394 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.379692 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.379948 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.380953 (+ 1005us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.381180 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 07:00:42.386933 11737 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 07:00:42.387048 11737 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 07:00:42.387210 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:00:42.388271 11708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62: Bootstrap starting.
I20260812 07:00:42.391225 11708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:42.392417 11708 log.cc:824] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:42.395646 11708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62: No bootstrap required, opened a new log
I20260812 07:00:42.392308 11345 master_runner.cc:186] Error getting master registration for 127.18.70.189:33675: OK, instance_id { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" instance_seqno: 1786518041837381 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 07:00:42.403242 11345 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 07:00:42.413527 11708 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } }
I20260812 07:00:42.415839 11708 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:42.416066 11708 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6387b4d87cf493c88f3a4d450ab8c62, State: Initialized, Role: FOLLOWER
I20260812 07:00:42.416850 11708 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } }
I20260812 07:00:42.423813 11754 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } } }
I20260812 07:00:42.425840 11754 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:00:42.425729 11708 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:00:42.449136 11716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.405014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58670 (local address 127.18.70.188:39397)
0812 07:00:42.405173 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.405179 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.420753 (+ 15574us) server_negotiation.cc:407] Connection header received
0812 07:00:42.421180 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.421186 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.421262 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.421328 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.426792 (+ 5464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.427869 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.435404 (+ 7535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.436098 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.436188 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.441039 (+ 4851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.441047 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.441052 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.441094 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.445056 (+ 3962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.446099 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.446105 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.446109 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.446279 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.446731 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.446737 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.446741 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.447129 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.448391 (+ 1262us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.448521 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.448742 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 07:00:42.452251 11586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.405230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48912 (local address 127.18.70.189:33675)
0812 07:00:42.405393 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.405399 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.415930 (+ 10531us) server_negotiation.cc:407] Connection header received
0812 07:00:42.416854 (+ 924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.416859 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.416936 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.417008 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.423713 (+ 6705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.424774 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.430611 (+ 5837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.431310 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.431415 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.440094 (+ 8679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.440102 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.440107 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.440150 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.447619 (+ 7469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.449457 (+ 1838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.449463 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.449467 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.449636 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.450101 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.450106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.450110 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.450455 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.450700 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.451690 (+ 990us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.451912 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 07:00:42.455123 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.404742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55636 (local address 127.18.70.190:43853)
0812 07:00:42.404900 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.404906 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.430407 (+ 25501us) server_negotiation.cc:407] Connection header received
0812 07:00:42.430564 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.430569 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.430648 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.430752 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.433033 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.434151 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.436209 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.436891 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.436983 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.440793 (+ 3810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.440800 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.440804 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.441985 (+ 1181us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.449312 (+ 7327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.451980 (+ 2668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.451985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.451988 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.452170 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.452624 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.452630 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.452634 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.453046 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.454268 (+ 1222us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.454443 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.454725 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260812 07:00:42.466270 11768 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 07:00:42.466435 11768 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 07:00:42.463563 11590 master_runner.cc:186] Error getting master registration for 127.18.70.189:33675: OK, instance_id { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" instance_seqno: 1786518041837381 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 07:00:42.472836 11590 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 07:00:42.540288 11754 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:00:42.540642 11754 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } }
I20260812 07:00:42.542299 11754 leader_election.cc:288] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2b20472a17c40e39398d2b9a62add24 (127.18.70.190:43853), 2f5dda69e04d4acab126fa9d9831d04a (127.18.70.189:33675)
I20260812 07:00:42.543144 11409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b20472a17c40e39398d2b9a62add24" is_pre_election: true
I20260812 07:00:42.543715 11409 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6387b4d87cf493c88f3a4d450ab8c62 in term 0.
W20260812 07:00:42.544317 11627 tablet.cc:2369] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:00:42.544601 11621 leader_election.cc:302] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6387b4d87cf493c88f3a4d450ab8c62, e2b20472a17c40e39398d2b9a62add24; no voters:
I20260812 07:00:42.545220 11754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:00:42.545388 11754 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:00:42.545504 11754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:42.548894 11754 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } }
I20260812 07:00:42.549875 11754 leader_election.cc:288] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [CANDIDATE]: Term 1 election: Requested vote from peers e2b20472a17c40e39398d2b9a62add24 (127.18.70.190:43853), 2f5dda69e04d4acab126fa9d9831d04a (127.18.70.189:33675)
I20260812 07:00:42.549925 11409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b20472a17c40e39398d2b9a62add24"
I20260812 07:00:42.550120 11409 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:42.553467 11409 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6387b4d87cf493c88f3a4d450ab8c62 in term 1.
I20260812 07:00:42.553663 11581 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } attempt: 5
I20260812 07:00:42.553882 11621 leader_election.cc:302] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6387b4d87cf493c88f3a4d450ab8c62, e2b20472a17c40e39398d2b9a62add24; no voters:
I20260812 07:00:42.555128 11754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [term 1 FOLLOWER]: Leader election won for term 1
Aug 12 07:00:42 dist-test-slave-tc2s krb5kdc[11323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518041, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
I20260812 07:00:42.566219 11754 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [term 1 LEADER]: Becoming Leader. State: Replica: d6387b4d87cf493c88f3a4d450ab8c62, State: Running, Role: LEADER
I20260812 07:00:42.567365 11754 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } }
I20260812 07:00:42.574643 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.554391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:39397 (local address 127.0.0.1:58686)
0812 07:00:42.554641 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:42.554661 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:42.554784 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:42.555316 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:42.555322 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:42.555860 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:42.556061 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.556075 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.557678 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.557684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.559117 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:42.559135 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.560335 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.560341 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:42.560587 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.561235 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:42.561259 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:42.567138 (+ 5879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:42.571809 (+ 4671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.571814 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.571818 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.572320 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.572755 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:42.572759 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:42.572763 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:42.572921 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:42.573650 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:42.573655 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:42.573809 (+ 154us) client_negotiation.cc:769] Sending connection context
0812 07:00:42.573975 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 07:00:42.574250 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260812 07:00:42.575623 11716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:42.554450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58686 (local address 127.18.70.188:39397)
0812 07:00:42.554621 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:42.554627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:42.554713 (+ 86us) server_negotiation.cc:407] Connection header received
0812 07:00:42.554904 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:42.554910 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:42.555037 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:42.555139 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:42.556269 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.557515 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.559286 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:42.560015 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:42.560136 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:42.567430 (+ 7294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:42.567437 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:42.567442 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:42.567478 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:42.571658 (+ 4180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.572458 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.572464 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.572468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.572622 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:42.573045 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:42.573050 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:42.573054 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:42.573423 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:42.573583 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:42.575011 (+ 1428us) server_negotiation.cc:299] Negotiation successful
0812 07:00:42.575251 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 07:00:42.581467 11581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a: Bootstrap starting.
I20260812 07:00:42.583215 11770 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6387b4d87cf493c88f3a4d450ab8c62. Latest consensus state: current_term: 1 leader_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } } }
I20260812 07:00:42.583632 11770 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:42.588522 11581 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:42.589949 11581 log.cc:824] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:42.593282 11581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a: No bootstrap required, opened a new log
I20260812 07:00:42.594923 11773 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:00:42.600057 11773 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:00:42.607937 11581 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } }
W20260812 07:00:42.608147 11381 tablet.cc:2369] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:00:42.608407 11581 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:42.608588 11581 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f5dda69e04d4acab126fa9d9831d04a, State: Initialized, Role: FOLLOWER
I20260812 07:00:42.609294 11581 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } }
I20260812 07:00:42.611865 11778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } } }
I20260812 07:00:42.612488 11778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:00:42.617760 11581 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:00:42.618234 11409 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [term 1 FOLLOWER]: Refusing update from remote peer d6387b4d87cf493c88f3a4d450ab8c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:00:42.619184 11545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f5dda69e04d4acab126fa9d9831d04a" is_pre_election: true
I20260812 07:00:42.619750 11545 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6387b4d87cf493c88f3a4d450ab8c62 in term 0.
I20260812 07:00:42.620106 11544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f5dda69e04d4acab126fa9d9831d04a"
I20260812 07:00:42.620330 11544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:42.623679 11544 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6387b4d87cf493c88f3a4d450ab8c62 in term 1.
I20260812 07:00:42.624420 11542 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [term 1 FOLLOWER]: Refusing update from remote peer d6387b4d87cf493c88f3a4d450ab8c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:00:42.624984 11770 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:00:42.625250 11754 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:00:42.647650 11778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6387b4d87cf493c88f3a4d450ab8c62. Latest consensus state: current_term: 1 leader_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } } }
I20260812 07:00:42.647931 11778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:00:42.651245 11777 mvcc.cc:205] Tried to move back new op lower bound from 7317577902547513344 to 7317577902366212096. Current Snapshot: MvccSnapshot[applied={T|T < 7317577902547513344}]
I20260812 07:00:42.652276 11785 mvcc.cc:205] Tried to move back new op lower bound from 7317577902547513344 to 7317577902366212096. Current Snapshot: MvccSnapshot[applied={T|T < 7317577902547513344}]
I20260812 07:00:42.658191 11778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } } }
I20260812 07:00:42.658412 11778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:00:42.662390 11754 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } } }
I20260812 07:00:42.662711 11754 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:42.664297 11773 catalog_manager.cc:1347] Generated new cluster ID: 4ebfab87905142739474f1d72df9f114
I20260812 07:00:42.664399 11773 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:00:42.678159 11721 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6387b4d87cf493c88f3a4d450ab8c62. Latest consensus state: current_term: 1 leader_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } } }
I20260812 07:00:42.678504 11721 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:00:42.685221 11721 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } } }
I20260812 07:00:42.685480 11721 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:00:42.691107 11770 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b20472a17c40e39398d2b9a62add24" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43853 } } peers { permanent_uuid: "2f5dda69e04d4acab126fa9d9831d04a" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 33675 } } peers { permanent_uuid: "d6387b4d87cf493c88f3a4d450ab8c62" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 39397 } } }
I20260812 07:00:42.691933 11770 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62 [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:42.693123 11773 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:00:42.694918 11773 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:00:42.711344 11773 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6387b4d87cf493c88f3a4d450ab8c62: Generated new TSK 0
I20260812 07:00:42.712275 11773 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:00:42.716049 11810 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 07:00:43.388844 11737 catalog_manager.cc:1259] Loaded cluster ID: 4ebfab87905142739474f1d72df9f114
I20260812 07:00:43.388932 11737 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24: loading cluster ID for follower catalog manager: success
I20260812 07:00:43.391433 11737 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24: acquiring CA information for follower catalog manager: success
I20260812 07:00:43.393085 11737 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e2b20472a17c40e39398d2b9a62add24: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 07:00:43.720288 11810 catalog_manager.cc:1259] Loaded cluster ID: 4ebfab87905142739474f1d72df9f114
I20260812 07:00:43.720407 11810 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a: loading cluster ID for follower catalog manager: success
I20260812 07:00:43.722976 11810 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a: acquiring CA information for follower catalog manager: success
I20260812 07:00:43.724740 11810 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2f5dda69e04d4acab126fa9d9831d04a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 07:00:43.799896 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 11345
I20260812 07:00:43.802014 11441 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:43.911659 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 11345
I20260812 07:00:43.941627 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 11455
I20260812 07:00:43.942831 11575 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:44.050186 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 11455
I20260812 07:00:44.077401 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 11590
I20260812 07:00:44.078536 11697 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:44.187505 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 11590
2026-08-12T07:00:44Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4703 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:00:44 dist-test-slave-tc2s krb5kdc[11830](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:00:44 dist-test-slave-tc2s krb5kdc[11830](info): set up 2 sockets
Aug 12 07:00:44 dist-test-slave-tc2s krb5kdc[11830](info): commencing operation
krb5kdc: starting...
W20260812 07:00:45.433192 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.003s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:00:45 dist-test-slave-tc2s krb5kdc[11830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:00:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:00:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:00:45.671082 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41319
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:44521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:41319
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:00:46.002238 11855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:46.002509 11855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:46.002645 11855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:46.009938 11855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:00:46.010052 11855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:46.010128 11855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:46.010200 11855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:00:46.010255 11855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:00:46.020147 11855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:41319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:46.021503 11855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:46.022805 11855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:46.034102 11866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:46.034184 11865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:46.034524 11873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:46.034818 11855 server_base.cc:1034] running on GCE node
I20260812 07:00:46.035563 11855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:46.036849 11855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:46.038033 11855 hybrid_clock.cc:648] HybridClock initialized: now 1786518046037990 us; error 33 us; skew 500 ppm
I20260812 07:00:46.038349 11855 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:46 dist-test-slave-tc2s krb5kdc[11830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518046, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:46.042012 11855 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:00:46.043744 11855 webserver.cc:460] Webserver started at http://127.18.70.190:38205/ using document root <none> and password file <none>
I20260812 07:00:46.044638 11855 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:46.044785 11855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:46.045142 11855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:00:46.049582 11855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "5a7638c64cdc4c828bb2b94064f4dec4"
format_stamp: "Formatted at 2026-08-12 07:00:46 on dist-test-slave-tc2s"
server_key: "1c7d85d169e3501332dcb2b62d86d6b2"
server_key_iv: "01802426ca1491e768c3532cb79d4e13"
server_key_version: "encryptionkey@0"
I20260812 07:00:46.050516 11855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "5a7638c64cdc4c828bb2b94064f4dec4"
format_stamp: "Formatted at 2026-08-12 07:00:46 on dist-test-slave-tc2s"
server_key: "1c7d85d169e3501332dcb2b62d86d6b2"
server_key_iv: "01802426ca1491e768c3532cb79d4e13"
server_key_version: "encryptionkey@0"
I20260812 07:00:46.055614 11855 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 07:00:46.058913 11888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:46.060127 11855 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 07:00:46.060276 11855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "5a7638c64cdc4c828bb2b94064f4dec4"
format_stamp: "Formatted at 2026-08-12 07:00:46 on dist-test-slave-tc2s"
server_key: "1c7d85d169e3501332dcb2b62d86d6b2"
server_key_iv: "01802426ca1491e768c3532cb79d4e13"
server_key_version: "encryptionkey@0"
I20260812 07:00:46.060485 11855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:46.079232 11855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:46.083070 11855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:46.083328 11855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:46.101351 11855 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:41319
I20260812 07:00:46.101370 11971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:41319 every 8 connection(s)
I20260812 07:00:46.102766 11855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:00:46.106474 11972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:46.112533 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 11855
I20260812 07:00:46.112732 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:00:46.113404 18714 external_mini_cluster.cc:1428] Setting key 3657affb43c97a3918f6989c07acfc98
I20260812 07:00:46.116978 11972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4: Bootstrap starting.
I20260812 07:00:46.120581 11972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:46.121572 11972 log.cc:824] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:46.124409 11972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4: No bootstrap required, opened a new log
Aug 12 07:00:46 dist-test-slave-tc2s krb5kdc[11830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:46.134276 11972 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7638c64cdc4c828bb2b94064f4dec4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41319 } }
I20260812 07:00:46.134725 11972 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:46.134842 11972 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7638c64cdc4c828bb2b94064f4dec4, State: Initialized, Role: FOLLOWER
I20260812 07:00:46.135488 11972 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7638c64cdc4c828bb2b94064f4dec4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41319 } }
I20260812 07:00:46.135790 11972 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:00:46.135936 11972 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:00:46.136145 11972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:46.137626 11978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:46.115207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51292 (local address 127.18.70.190:41319)
0812 07:00:46.115936 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:46.115949 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:46.115989 (+ 40us) server_negotiation.cc:407] Connection header received
0812 07:00:46.117711 (+ 1722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:46.117735 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:46.118121 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:46.118431 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:46.120340 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:46.121699 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:46.123334 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:46.123974 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:46.124104 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:46.128926 (+ 4822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:46.128936 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:46.128954 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:46.129025 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:46.133069 (+ 4044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:46.133787 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:46.133796 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:46.133804 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:46.134042 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:46.134425 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:46.134429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:46.134432 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:46.135131 (+ 699us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:46.135445 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:46.135834 (+ 389us) server_negotiation.cc:299] Negotiation successful
0812 07:00:46.136279 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":332,"threads_started":1}
I20260812 07:00:46.138976 11972 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7638c64cdc4c828bb2b94064f4dec4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41319 } }
I20260812 07:00:46.139454 11972 leader_election.cc:302] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a7638c64cdc4c828bb2b94064f4dec4; no voters:
I20260812 07:00:46.140041 11972 leader_election.cc:288] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:00:46.140172 11982 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:00:46.141368 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:00:46.141438 11982 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7638c64cdc4c828bb2b94064f4dec4, State: Running, Role: LEADER
I20260812 07:00:46.141997 11982 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7638c64cdc4c828bb2b94064f4dec4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41319 } }
I20260812 07:00:46.142269 11972 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:00:46.144791 11983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a7638c64cdc4c828bb2b94064f4dec4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7638c64cdc4c828bb2b94064f4dec4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41319 } } }
I20260812 07:00:46.145196 11983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:46.150192 11984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a7638c64cdc4c828bb2b94064f4dec4. Latest consensus state: current_term: 1 leader_uuid: "5a7638c64cdc4c828bb2b94064f4dec4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7638c64cdc4c828bb2b94064f4dec4" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41319 } } }
I20260812 07:00:46.150580 11991 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:00:46.150590 11984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4 [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:46.155742 11991 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:00:46.165047 11991 catalog_manager.cc:1347] Generated new cluster ID: 6fbb9a25fb5b478a8f4bf6a795e4dd90
I20260812 07:00:46.165155 11991 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:00:46.186391 11991 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:00:46.187700 11991 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:00:46.194324 11991 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a7638c64cdc4c828bb2b94064f4dec4: Generated new TSK 0
I20260812 07:00:46.195181 11991 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:00:46.253571 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 11855
I20260812 07:00:46.254737 11965 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:46.353489 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 11855
2026-08-12T07:00:46Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2168 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:00:46 dist-test-slave-tc2s krb5kdc[12035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:00:46 dist-test-slave-tc2s krb5kdc[12035](info): set up 2 sockets
Aug 12 07:00:46 dist-test-slave-tc2s krb5kdc[12035](info): commencing operation
krb5kdc: starting...
W20260812 07:00:47.639403 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.003s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:00:47 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:00:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:00:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:00:47.895661 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36193
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:36193
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:00:48.233211 12066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:48.233561 12066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:48.233723 12066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:48.241216 12066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:00:48.241334 12066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:48.241423 12066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:48.241506 12066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:00:48.241567 12066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:00:48.251748 12066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:36193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:48.253067 12066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:48.254453 12066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:48.265882 12073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:48.266026 12076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:48.266089 12078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:48.266842 12066 server_base.cc:1034] running on GCE node
I20260812 07:00:48.267668 12066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:48.269078 12066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:48.270280 12066 hybrid_clock.cc:648] HybridClock initialized: now 1786518048270230 us; error 31 us; skew 500 ppm
I20260812 07:00:48.270627 12066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:48 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518048, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:48.273677 12066 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:00:48.275179 12066 webserver.cc:460] Webserver started at http://127.18.70.190:43777/ using document root <none> and password file <none>
I20260812 07:00:48.275857 12066 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:48.275975 12066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:48.276248 12066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:00:48.279318 12066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "2dc7f3a5d2cc46f1b845b1d045154584"
format_stamp: "Formatted at 2026-08-12 07:00:48 on dist-test-slave-tc2s"
server_key: "8d6c220e3e7582306e24aefc7f9b9f28"
server_key_iv: "fff2c68b10f160bf15e7ce04788567b9"
server_key_version: "encryptionkey@0"
I20260812 07:00:48.280069 12066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "2dc7f3a5d2cc46f1b845b1d045154584"
format_stamp: "Formatted at 2026-08-12 07:00:48 on dist-test-slave-tc2s"
server_key: "8d6c220e3e7582306e24aefc7f9b9f28"
server_key_iv: "fff2c68b10f160bf15e7ce04788567b9"
server_key_version: "encryptionkey@0"
I20260812 07:00:48.285200 12066 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 07:00:48.288561 12087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:48.289829 12066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 07:00:48.290066 12066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "2dc7f3a5d2cc46f1b845b1d045154584"
format_stamp: "Formatted at 2026-08-12 07:00:48 on dist-test-slave-tc2s"
server_key: "8d6c220e3e7582306e24aefc7f9b9f28"
server_key_iv: "fff2c68b10f160bf15e7ce04788567b9"
server_key_version: "encryptionkey@0"
I20260812 07:00:48.290247 12066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:48.312495 12066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:48.316975 12066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:48.317246 12066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:48.334829 12066 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:36193
I20260812 07:00:48.334867 12177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:36193 every 8 connection(s)
I20260812 07:00:48.336138 12066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:00:48.339804 12181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:48.340332 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 12066
I20260812 07:00:48.340523 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:00:48.341154 18714 external_mini_cluster.cc:1428] Setting key a7460824145fa81a440e84d655b1b502
I20260812 07:00:48.353266 12181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Bootstrap starting.
Aug 12 07:00:48 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:48.356853 12181 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:48.357878 12181 log.cc:824] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:48.360736 12181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: No bootstrap required, opened a new log
I20260812 07:00:48.364182 12188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:48.343165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38942 (local address 127.18.70.190:36193)
0812 07:00:48.343962 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:48.343979 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:48.344019 (+ 40us) server_negotiation.cc:407] Connection header received
0812 07:00:48.345669 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:48.345691 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:48.346115 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:48.346485 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:48.348319 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:48.349639 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:48.351449 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:48.352098 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:48.352216 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:48.357054 (+ 4838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:48.357064 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:48.357079 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:48.357123 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:48.360128 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:48.360817 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:48.360825 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:48.360833 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:48.361019 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:48.361396 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:48.361400 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:48.361402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:48.361971 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:48.362308 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:48.362771 (+ 463us) server_negotiation.cc:299] Negotiation successful
0812 07:00:48.363181 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":339,"threads_started":1}
I20260812 07:00:48.368675 12181 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:48.369082 12181 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:48.369202 12181 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc7f3a5d2cc46f1b845b1d045154584, State: Initialized, Role: FOLLOWER
I20260812 07:00:48.369700 12181 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:48.369932 12181 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:00:48.370050 12181 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:00:48.370182 12181 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:48.372274 12181 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:48.372720 12181 leader_election.cc:302] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2dc7f3a5d2cc46f1b845b1d045154584; no voters:
I20260812 07:00:48.373226 12181 leader_election.cc:288] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:00:48.373375 12191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:00:48.374038 12191 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 1 LEADER]: Becoming Leader. State: Replica: 2dc7f3a5d2cc46f1b845b1d045154584, State: Running, Role: LEADER
I20260812 07:00:48.374578 12191 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:48.375206 12181 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:00:48.377303 12195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2dc7f3a5d2cc46f1b845b1d045154584. Latest consensus state: current_term: 1 leader_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } } }
I20260812 07:00:48.377912 12195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:48.377286 12193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } } }
I20260812 07:00:48.378512 12193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:48.379880 12210 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:00:48.384434 12210 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:00:48.393844 12210 catalog_manager.cc:1347] Generated new cluster ID: db824a1c1a6a4e2281a40416c43c18af
I20260812 07:00:48.394006 12210 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:00:48.414206 12210 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:00:48.416095 12210 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:00:48.427201 12210 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Generated new TSK 0
I20260812 07:00:48.428282 12210 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 07:00:48.495298 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36193
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:00:48.835125 12234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:48.835414 12234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:48.835559 12234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:48.842725 12234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:48.842839 12234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:48.842994 12234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:00:48.852464 12234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:48.853772 12234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:48.855130 12234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:48.867905 12244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:48.868081 12247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:48.867934 12243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:48.868728 12234 server_base.cc:1034] running on GCE node
I20260812 07:00:48.869309 12234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:48.870250 12234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:48.871449 12234 hybrid_clock.cc:648] HybridClock initialized: now 1786518048871403 us; error 44 us; skew 500 ppm
I20260812 07:00:48.871742 12234 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:48 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518048, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:48.874702 12234 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 07:00:48.876168 12234 webserver.cc:460] Webserver started at http://127.18.70.129:44857/ using document root <none> and password file <none>
I20260812 07:00:48.876843 12234 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:48.876959 12234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:48.877243 12234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:00:48.880272 12234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "6cc6467ed9574db9989e6a75b2647981"
format_stamp: "Formatted at 2026-08-12 07:00:48 on dist-test-slave-tc2s"
server_key: "693dfbf4f4524799e871b813eaf54bc8"
server_key_iv: "c733d7236bf18676856a3d809e518051"
server_key_version: "encryptionkey@0"
I20260812 07:00:48.881105 12234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "6cc6467ed9574db9989e6a75b2647981"
format_stamp: "Formatted at 2026-08-12 07:00:48 on dist-test-slave-tc2s"
server_key: "693dfbf4f4524799e871b813eaf54bc8"
server_key_iv: "c733d7236bf18676856a3d809e518051"
server_key_version: "encryptionkey@0"
I20260812 07:00:48.886183 12234 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 07:00:48.889523 12262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:48.890805 12234 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:00:48.890961 12234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "6cc6467ed9574db9989e6a75b2647981"
format_stamp: "Formatted at 2026-08-12 07:00:48 on dist-test-slave-tc2s"
server_key: "693dfbf4f4524799e871b813eaf54bc8"
server_key_iv: "c733d7236bf18676856a3d809e518051"
server_key_version: "encryptionkey@0"
I20260812 07:00:48.891144 12234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:48.916828 12234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:48.921053 12234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:48.921370 12234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:48.922394 12234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:48.923763 12234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:48.923846 12234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:48.923965 12234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:48.924021 12234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:48.954406 12234 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:35997
I20260812 07:00:48.954456 12461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:35997 every 8 connection(s)
I20260812 07:00:48.955698 12234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:00:48.963160 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 12234
I20260812 07:00:48.963359 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 07:00:48.964066 18714 external_mini_cluster.cc:1428] Setting key 4317d1dede786db3c25b9239c0df61e2
Aug 12 07:00:48 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518048, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:48.975172 12472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:48.958120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:53219 (local address 127.18.70.190:36193)
0812 07:00:48.958565 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:48.958570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:48.959451 (+ 881us) server_negotiation.cc:407] Connection header received
0812 07:00:48.961336 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:48.961342 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:48.961420 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:48.961521 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:48.963094 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:48.963911 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:48.965608 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:48.966168 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:48.966287 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:48.969769 (+ 3482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:48.969774 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:48.969777 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:48.969809 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:48.972190 (+ 2381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:48.972867 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:48.972872 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:48.972876 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:48.972998 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:48.973399 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:48.973404 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:48.973408 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:48.973675 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:48.973809 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:48.974569 (+ 760us) server_negotiation.cc:299] Negotiation successful
0812 07:00:48.974804 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":219,"threads_started":1}
I20260812 07:00:48.976207 12473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:48.958613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:53219)
0812 07:00:48.959301 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:48.959347 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:48.961072 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:48.961774 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:48.961782 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:48.962344 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:48.962916 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:48.962934 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:48.964064 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:48.964069 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:48.965451 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:48.965464 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:48.966398 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:48.966405 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:48.966635 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:48.967275 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:48.967298 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:48.969558 (+ 2260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:48.972319 (+ 2761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:48.972328 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:48.972344 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:48.972755 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:48.973102 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:48.973108 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:48.973111 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:48.973292 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:48.973809 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:48.973817 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:48.974195 (+ 378us) client_negotiation.cc:769] Sending connection context
0812 07:00:48.974437 (+ 242us) client_negotiation.cc:240] Negotiation successful
0812 07:00:48.975001 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":267,"threads_started":1}
I20260812 07:00:48.977735 12462 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36193
I20260812 07:00:48.978099 12462 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:48.978950 12462 heartbeater.cc:511] Master 127.18.70.190:36193 requested a full tablet report, sending...
I20260812 07:00:48.981489 12120 ts_manager.cc:194] Registered new tserver with Master: 6cc6467ed9574db9989e6a75b2647981 (127.18.70.129:35997)
I20260812 07:00:48.983480 12120 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:53219
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 07:00:49.023546 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36193
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:00:49.357586 12479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:49.357872 12479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:49.358035 12479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:49.365501 12479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:49.365622 12479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:49.365787 12479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:00:49.375663 12479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:49.376968 12479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:49.378331 12479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:49.391449 12495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:49.391511 12486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:49.391486 12488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:49.392519 12479 server_base.cc:1034] running on GCE node
I20260812 07:00:49.393051 12479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:49.394033 12479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:49.395231 12479 hybrid_clock.cc:648] HybridClock initialized: now 1786518049395172 us; error 49 us; skew 500 ppm
I20260812 07:00:49.395556 12479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:49 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518049, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:49.398710 12479 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 07:00:49.400121 12479 webserver.cc:460] Webserver started at http://127.18.70.130:40405/ using document root <none> and password file <none>
I20260812 07:00:49.400774 12479 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:49.400897 12479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:49.401183 12479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:00:49.404443 12479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a"
format_stamp: "Formatted at 2026-08-12 07:00:49 on dist-test-slave-tc2s"
server_key: "57a687d584c0b056fa59ab5f56bbf5c8"
server_key_iv: "b0840aff2b0a1a4529d8d60b7cd0a3a4"
server_key_version: "encryptionkey@0"
I20260812 07:00:49.405578 12479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a"
format_stamp: "Formatted at 2026-08-12 07:00:49 on dist-test-slave-tc2s"
server_key: "57a687d584c0b056fa59ab5f56bbf5c8"
server_key_iv: "b0840aff2b0a1a4529d8d60b7cd0a3a4"
server_key_version: "encryptionkey@0"
I20260812 07:00:49.412402 12479 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 07:00:49.416317 12505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:49.418529 12479 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 07:00:49.418707 12479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a"
format_stamp: "Formatted at 2026-08-12 07:00:49 on dist-test-slave-tc2s"
server_key: "57a687d584c0b056fa59ab5f56bbf5c8"
server_key_iv: "b0840aff2b0a1a4529d8d60b7cd0a3a4"
server_key_version: "encryptionkey@0"
I20260812 07:00:49.419000 12479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:49.450716 12479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:49.456205 12479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:49.456501 12479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:49.457587 12479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:49.459038 12479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:49.459124 12479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:49.459254 12479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:49.459314 12479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:49.492132 12479 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:39525
I20260812 07:00:49.492172 12726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:39525 every 8 connection(s)
I20260812 07:00:49.493419 12479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:00:49.500726 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 12479
I20260812 07:00:49.500898 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 07:00:49.501348 18714 external_mini_cluster.cc:1428] Setting key 7d8cadffaeea9a7cd07381757c91dfe2
Aug 12 07:00:49 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518049, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:49.512730 12735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:49.496238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:42025 (local address 127.18.70.190:36193)
0812 07:00:49.496684 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:49.496689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:49.497504 (+ 815us) server_negotiation.cc:407] Connection header received
0812 07:00:49.499375 (+ 1871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:49.499380 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:49.499460 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:49.499559 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:49.501091 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:49.501860 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:49.503401 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:49.503829 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:49.503939 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:49.507269 (+ 3330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:49.507274 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:49.507278 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:49.507310 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:49.509776 (+ 2466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:49.510482 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:49.510486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:49.510489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:49.510622 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:49.511037 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:49.511041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:49.511043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:49.511299 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:49.511432 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:49.512115 (+ 683us) server_negotiation.cc:299] Negotiation successful
0812 07:00:49.512341 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":243,"threads_started":1}
I20260812 07:00:49.513679 12738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:49.496656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:42025)
0812 07:00:49.497344 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:49.497385 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:49.499114 (+ 1729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:49.499797 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:49.499805 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:49.500318 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:49.500922 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:49.500946 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:49.502031 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:49.502035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:49.503263 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:49.503276 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:49.504051 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:49.504059 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:49.504288 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:49.504898 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:49.504933 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:49.507057 (+ 2124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:49.509925 (+ 2868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:49.509934 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:49.509950 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:49.510371 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:49.510727 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:49.510732 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:49.510736 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:49.510917 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:49.511419 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:49.511427 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:49.511760 (+ 333us) client_negotiation.cc:769] Sending connection context
0812 07:00:49.511986 (+ 226us) client_negotiation.cc:240] Negotiation successful
0812 07:00:49.512493 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":263,"threads_started":1}
I20260812 07:00:49.515164 12728 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36193
I20260812 07:00:49.515453 12728 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:49.516183 12728 heartbeater.cc:511] Master 127.18.70.190:36193 requested a full tablet report, sending...
I20260812 07:00:49.517683 12120 ts_manager.cc:194] Registered new tserver with Master: 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525)
I20260812 07:00:49.518798 12120 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:42025
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 07:00:49.557370 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36193
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:00:49.892668 12742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:49.893018 12742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:49.893162 12742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:49.900846 12742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:49.900951 12742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:49.901110 12742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:00:49.910981 12742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:49.912308 12742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:49.913614 12742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:49.926752 12752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:49.926704 12753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:49.926779 12756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:49.927532 12742 server_base.cc:1034] running on GCE node
I20260812 07:00:49.928117 12742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:49.929037 12742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:49.930228 12742 hybrid_clock.cc:648] HybridClock initialized: now 1786518049930187 us; error 32 us; skew 500 ppm
I20260812 07:00:49.930516 12742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:49 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518049, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:49.933574 12742 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 07:00:49.934959 12742 webserver.cc:460] Webserver started at http://127.18.70.131:38807/ using document root <none> and password file <none>
I20260812 07:00:49.935595 12742 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:49.935707 12742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:49.935995 12742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:00:49.938949 12742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "b83b6d3b91ec45e395d4a6dae1ce7532"
format_stamp: "Formatted at 2026-08-12 07:00:49 on dist-test-slave-tc2s"
server_key: "6e061162391c702e81d2cbd02f236efe"
server_key_iv: "af8682c794a5528bfa869a8c51fef7e4"
server_key_version: "encryptionkey@0"
I20260812 07:00:49.939734 12742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "b83b6d3b91ec45e395d4a6dae1ce7532"
format_stamp: "Formatted at 2026-08-12 07:00:49 on dist-test-slave-tc2s"
server_key: "6e061162391c702e81d2cbd02f236efe"
server_key_iv: "af8682c794a5528bfa869a8c51fef7e4"
server_key_version: "encryptionkey@0"
I20260812 07:00:49.944763 12742 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 07:00:49.948199 12767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:49.949467 12742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 07:00:49.949620 12742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "b83b6d3b91ec45e395d4a6dae1ce7532"
format_stamp: "Formatted at 2026-08-12 07:00:49 on dist-test-slave-tc2s"
server_key: "6e061162391c702e81d2cbd02f236efe"
server_key_iv: "af8682c794a5528bfa869a8c51fef7e4"
server_key_version: "encryptionkey@0"
I20260812 07:00:49.949795 12742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:49.975204 12742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:49.979442 12742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:49.979715 12742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:49.980777 12742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:49.982200 12742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:49.982280 12742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:49.982396 12742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:49.982450 12742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:49.986977 12462 heartbeater.cc:503] Master 127.18.70.190:36193 was elected leader, sending a full tablet report...
I20260812 07:00:50.013434 12742 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:34109
I20260812 07:00:50.013478 12990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:34109 every 8 connection(s)
I20260812 07:00:50.014758 12742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:00:50.019840 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 12742
I20260812 07:00:50.019996 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 07:00:50.020502 18714 external_mini_cluster.cc:1428] Setting key 442c3b4813365a04abf8e1fa050944d4
Aug 12 07:00:50 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518049, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:50.034452 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.017250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:42801 (local address 127.18.70.190:36193)
0812 07:00:50.017745 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:50.017751 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:50.018629 (+ 878us) server_negotiation.cc:407] Connection header received
0812 07:00:50.020473 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:50.020479 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:50.020584 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:50.020718 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:50.022350 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.023241 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.024772 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.025242 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.025336 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.028723 (+ 3387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:50.028728 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:50.028731 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:50.028764 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:50.031349 (+ 2585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:50.032045 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:50.032049 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:50.032051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:50.032178 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:50.032629 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:50.032633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:50.032635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:50.032917 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:50.033059 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:50.033776 (+ 717us) server_negotiation.cc:299] Negotiation successful
0812 07:00:50.034035 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":223,"threads_started":1}
I20260812 07:00:50.035507 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.017759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:42801)
0812 07:00:50.018477 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:50.018515 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:50.020201 (+ 1686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:50.020926 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:50.020934 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:50.021458 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:50.022173 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.022192 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.023387 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.023392 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.024637 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.024655 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.025432 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.025438 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.025634 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.026282 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:50.026304 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:50.028519 (+ 2215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:50.031482 (+ 2963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:50.031492 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:50.031508 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:50.031920 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:50.032289 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:50.032294 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:50.032297 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:50.032501 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:50.033048 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:50.033056 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:50.033387 (+ 331us) client_negotiation.cc:769] Sending connection context
0812 07:00:50.033629 (+ 242us) client_negotiation.cc:240] Negotiation successful
0812 07:00:50.034217 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":285,"threads_started":1}
I20260812 07:00:50.036826 12992 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36193
I20260812 07:00:50.037134 12992 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:50.037848 12992 heartbeater.cc:511] Master 127.18.70.190:36193 requested a full tablet report, sending...
I20260812 07:00:50.039283 12120 ts_manager.cc:194] Registered new tserver with Master: b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109)
I20260812 07:00:50.040051 12120 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:42801
I20260812 07:00:50.047969 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 07:00:50.063877 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.052351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38952 (local address 127.18.70.190:36193)
0812 07:00:50.052529 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:50.052536 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:50.052913 (+ 377us) server_negotiation.cc:407] Connection header received
0812 07:00:50.053065 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:50.053068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:50.053142 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:50.053214 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:50.054676 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.055404 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.056693 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.057120 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.057207 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.059412 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:50.059416 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:50.059419 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:50.059445 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:50.061734 (+ 2289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:50.062331 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:50.062334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:50.062336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:50.062459 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:50.062733 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:50.062736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:50.062738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:50.063046 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:50.063215 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:50.063437 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 07:00:50.063599 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 07:00:50.067819 12120 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 07:00:50.075222 12120 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 07:00:50.102133 13022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.087486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35997 (local address 127.0.0.1:34696)
0812 07:00:50.089541 (+ 2055us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:50.089576 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:50.089782 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:50.094104 (+ 4322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:50.094108 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:50.094133 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:50.094548 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.094563 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.096563 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.096569 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.099114 (+ 2545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.099130 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.101065 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.101072 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.101262 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.101316 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 07:00:50.101425 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 07:00:50.101617 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1800,"mutex_wait_us":64,"spinlock_wait_cycles":9856,"thread_start_us":1659,"threads_started":1}
I20260812 07:00:50.103286 13025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.088003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:34109 (local address 127.0.0.1:34878)
0812 07:00:50.089595 (+ 1592us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:50.089612 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:50.089781 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:50.093299 (+ 3518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:50.093306 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:50.093336 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:50.093861 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.093877 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.097155 (+ 3278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.097161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.100462 (+ 3301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.100479 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.102441 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.102447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.102630 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.102664 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 07:00:50.102744 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 07:00:50.102872 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1497,"mutex_wait_us":1,"spinlock_wait_cycles":3840,"thread_start_us":1932,"threads_started":1}
I20260812 07:00:50.103469 13023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.087648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34696 (local address 127.18.70.129:35997)
0812 07:00:50.088841 (+ 1193us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:50.088851 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:50.089710 (+ 859us) server_negotiation.cc:407] Connection header received
0812 07:00:50.093366 (+ 3656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:50.093374 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:50.093612 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:50.093839 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:50.094750 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.096417 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.099309 (+ 2892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.100821 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.102638 (+ 1817us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.102913 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:50.103004 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 07:00:50.103167 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":978,"thread_start_us":807,"threads_started":1}
I20260812 07:00:50.105522 13024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.088627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34878 (local address 127.18.70.131:34109)
0812 07:00:50.089360 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:50.089368 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:50.089961 (+ 593us) server_negotiation.cc:407] Connection header received
0812 07:00:50.090081 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:50.090089 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:50.090337 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:50.090512 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:50.094128 (+ 3616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.096988 (+ 2860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.100654 (+ 3666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.102091 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.104706 (+ 2615us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.104949 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:50.105032 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 07:00:50.105202 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":392,"threads_started":1}
I20260812 07:00:50.109237 12867 tablet_service.cc:1467] Processing CreateTablet for tablet 00ded6e9c8154f2d9e05215dcd37299b (DEFAULT_TABLE table=test-table [id=9ee1c769a64841d98c5f7087d8f2aecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:00:50.109237 12344 tablet_service.cc:1467] Processing CreateTablet for tablet 00ded6e9c8154f2d9e05215dcd37299b (DEFAULT_TABLE table=test-table [id=9ee1c769a64841d98c5f7087d8f2aecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:00:50.110201 13022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.089999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:39525 (local address 127.0.0.1:43492)
0812 07:00:50.102381 (+ 12382us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:50.102399 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:50.102494 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:50.104808 (+ 2314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:50.104814 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:50.104844 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:50.105034 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.105045 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.106833 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.106838 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.108026 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.108038 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.109282 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.109289 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.109460 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.109492 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 07:00:50.109596 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 07:00:50.109757 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12282,"thread_start_us":15172,"threads_started":1}
I20260812 07:00:50.110834 12344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00ded6e9c8154f2d9e05215dcd37299b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:50.110836 12867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00ded6e9c8154f2d9e05215dcd37299b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:50.111008 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.090295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43492 (local address 127.18.70.130:39525)
0812 07:00:50.104123 (+ 13828us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:50.104132 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:50.104167 (+ 35us) server_negotiation.cc:407] Connection header received
0812 07:00:50.104274 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:50.104284 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:50.104549 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:50.104801 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:50.105229 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.106707 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.108175 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.109121 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.109245 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.109430 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:50.110563 (+ 1133us) server_negotiation.cc:299] Negotiation successful
0812 07:00:50.110732 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13617,"thread_start_us":13466,"threads_started":1}
I20260812 07:00:50.113883 12597 tablet_service.cc:1467] Processing CreateTablet for tablet 00ded6e9c8154f2d9e05215dcd37299b (DEFAULT_TABLE table=test-table [id=9ee1c769a64841d98c5f7087d8f2aecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:00:50.115029 12597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00ded6e9c8154f2d9e05215dcd37299b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:50.126585 13031 tablet_bootstrap.cc:492] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: Bootstrap starting.
I20260812 07:00:50.127246 13030 tablet_bootstrap.cc:492] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: Bootstrap starting.
I20260812 07:00:50.128803 13032 tablet_bootstrap.cc:492] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Bootstrap starting.
I20260812 07:00:50.130360 13031 tablet_bootstrap.cc:654] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:50.130733 13030 tablet_bootstrap.cc:654] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:50.131666 13030 log.cc:824] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:50.131693 13031 log.cc:824] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:50.132253 13032 tablet_bootstrap.cc:654] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:50.133289 13032 log.cc:824] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:50.134685 13030 tablet_bootstrap.cc:492] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: No bootstrap required, opened a new log
I20260812 07:00:50.134788 13031 tablet_bootstrap.cc:492] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: No bootstrap required, opened a new log
I20260812 07:00:50.134987 13030 ts_tablet_manager.cc:1397] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260812 07:00:50.135026 13031 ts_tablet_manager.cc:1397] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260812 07:00:50.136246 13032 tablet_bootstrap.cc:492] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: No bootstrap required, opened a new log
I20260812 07:00:50.136497 13032 ts_tablet_manager.cc:1397] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260812 07:00:50.142379 13031 raft_consensus.cc:348] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } } peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } }
I20260812 07:00:50.142726 13031 raft_consensus.cc:374] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:50.142818 13031 raft_consensus.cc:729] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83b6d3b91ec45e395d4a6dae1ce7532, State: Initialized, Role: FOLLOWER
I20260812 07:00:50.143391 13031 consensus_queue.cc:260] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } } peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } }
I20260812 07:00:50.144433 12992 heartbeater.cc:503] Master 127.18.70.190:36193 was elected leader, sending a full tablet report...
I20260812 07:00:50.145145 13031 ts_tablet_manager.cc:1428] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: Time spent starting tablet: real 0.010s user 0.002s sys 0.007s
I20260812 07:00:50.145257 13030 raft_consensus.cc:348] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } } peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } }
I20260812 07:00:50.145674 13030 raft_consensus.cc:374] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:50.145773 13030 raft_consensus.cc:729] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6467ed9574db9989e6a75b2647981, State: Initialized, Role: FOLLOWER
I20260812 07:00:50.146389 13030 consensus_queue.cc:260] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } } peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } }
I20260812 07:00:50.146623 13032 raft_consensus.cc:348] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } } peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } }
I20260812 07:00:50.147056 13032 raft_consensus.cc:374] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:50.147161 13032 raft_consensus.cc:729] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aaf3457ba9d4bbba3cf4561ac9eea9a, State: Initialized, Role: FOLLOWER
I20260812 07:00:50.147693 13032 consensus_queue.cc:260] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } } peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } }
I20260812 07:00:50.148757 12728 heartbeater.cc:503] Master 127.18.70.190:36193 was elected leader, sending a full tablet report...
I20260812 07:00:50.149427 13030 ts_tablet_manager.cc:1428] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260812 07:00:50.151021 13032 ts_tablet_manager.cc:1428] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
W20260812 07:00:50.208082 12468 tablet.cc:2369] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:00:50.245669 12729 tablet.cc:2369] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:00:50.266314 12993 tablet.cc:2369] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:00:50.386134 13042 raft_consensus.cc:482] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:00:50.386410 13042 raft_consensus.cc:504] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } } peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } }
I20260812 07:00:50.388151 13042 leader_election.cc:288] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525), b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109)
I20260812 07:00:50.395478 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.388488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:43883 (local address 127.18.70.130:39525)
0812 07:00:50.388724 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:50.388730 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:50.389448 (+ 718us) server_negotiation.cc:407] Connection header received
0812 07:00:50.389699 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:50.389705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:50.389799 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:50.389927 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:50.390520 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.391406 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.393506 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.394441 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.394556 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.394610 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:50.395047 (+ 437us) server_negotiation.cc:299] Negotiation successful
0812 07:00:50.395183 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 07:00:50.395555 13024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.388720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:59777 (local address 127.18.70.131:34109)
0812 07:00:50.388958 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:50.388965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:50.390066 (+ 1101us) server_negotiation.cc:407] Connection header received
0812 07:00:50.390240 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:50.390245 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:50.390322 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:50.390418 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:50.391000 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.391843 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.393714 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.394643 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.394787 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.394874 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:50.395193 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 07:00:50.395322 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 07:00:50.395876 13045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.388374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:39525 (local address 127.18.70.129:43883)
0812 07:00:50.389331 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:50.389352 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:50.389516 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:50.389958 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:50.389962 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:50.389985 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:50.390371 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.390385 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.391530 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.391535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.393346 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.393359 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.394638 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.394644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.394891 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.394922 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 07:00:50.394994 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 07:00:50.395116 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":816,"mutex_wait_us":46,"thread_start_us":597,"threads_started":1}
I20260812 07:00:50.395902 13046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.388681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:34109 (local address 127.18.70.129:59777)
0812 07:00:50.389963 (+ 1282us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:50.389981 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:50.390115 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:50.390446 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:50.390450 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:50.390475 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:50.390819 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.390831 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.391989 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.391992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.393550 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:50.393564 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.394878 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.394885 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:50.395034 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.395067 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 07:00:50.395156 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 07:00:50.395274 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1110,"mutex_wait_us":21,"thread_start_us":911,"threads_started":1}
I20260812 07:00:50.396792 12631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00ded6e9c8154f2d9e05215dcd37299b" candidate_uuid: "6cc6467ed9574db9989e6a75b2647981" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" is_pre_election: true
I20260812 07:00:50.396943 12908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00ded6e9c8154f2d9e05215dcd37299b" candidate_uuid: "6cc6467ed9574db9989e6a75b2647981" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" is_pre_election: true
I20260812 07:00:50.397336 12631 raft_consensus.cc:2454] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6467ed9574db9989e6a75b2647981 in term 0.
I20260812 07:00:50.397444 12908 raft_consensus.cc:2454] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6467ed9574db9989e6a75b2647981 in term 0.
I20260812 07:00:50.398005 12263 leader_election.cc:302] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4aaf3457ba9d4bbba3cf4561ac9eea9a, 6cc6467ed9574db9989e6a75b2647981; no voters:
I20260812 07:00:50.398401 13042 raft_consensus.cc:2781] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:00:50.398561 13042 raft_consensus.cc:482] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:00:50.398666 13042 raft_consensus.cc:3037] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:50.400846 13042 raft_consensus.cc:504] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } } peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } }
I20260812 07:00:50.401434 13042 leader_election.cc:288] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 1 election: Requested vote from peers 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525), b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109)
I20260812 07:00:50.401865 12631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00ded6e9c8154f2d9e05215dcd37299b" candidate_uuid: "6cc6467ed9574db9989e6a75b2647981" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a"
I20260812 07:00:50.401909 12908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00ded6e9c8154f2d9e05215dcd37299b" candidate_uuid: "6cc6467ed9574db9989e6a75b2647981" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532"
I20260812 07:00:50.402081 12631 raft_consensus.cc:3037] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:50.402083 12908 raft_consensus.cc:3037] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:50.404266 12908 raft_consensus.cc:2454] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6467ed9574db9989e6a75b2647981 in term 1.
I20260812 07:00:50.404392 12631 raft_consensus.cc:2454] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6467ed9574db9989e6a75b2647981 in term 1.
I20260812 07:00:50.404642 12264 leader_election.cc:302] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6467ed9574db9989e6a75b2647981, b83b6d3b91ec45e395d4a6dae1ce7532; no voters:
I20260812 07:00:50.404930 13042 raft_consensus.cc:2781] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:00:50.405336 13042 raft_consensus.cc:686] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc6467ed9574db9989e6a75b2647981, State: Running, Role: LEADER
I20260812 07:00:50.405833 13042 consensus_queue.cc:237] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } } peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } }
I20260812 07:00:50.410252 12120 catalog_manager.cc:5495] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc6467ed9574db9989e6a75b2647981 (127.18.70.129). New cstate: current_term: 1 leader_uuid: "6cc6467ed9574db9989e6a75b2647981" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260812 07:00:50.463272 13023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.458178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34712 (local address 127.18.70.129:35997)
0812 07:00:50.458378 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:50.458383 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:50.458401 (+ 18us) server_negotiation.cc:407] Connection header received
0812 07:00:50.458491 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:50.458495 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:50.458578 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:50.458697 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:00:50.459022 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.459741 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.461260 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.461684 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.461780 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.462284 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:00:50.462790 (+ 506us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:00:50.462900 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:50.462942 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 07:00:50.463006 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 07:00:50.471105 12908 raft_consensus.cc:1261] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532 [term 1 FOLLOWER]: Refusing update from remote peer 6cc6467ed9574db9989e6a75b2647981: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:00:50.471132 12631 raft_consensus.cc:1261] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 1 FOLLOWER]: Refusing update from remote peer 6cc6467ed9574db9989e6a75b2647981: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:00:50.472029 13047 consensus_queue.cc:1035] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:00:50.472345 13042 consensus_queue.cc:1035] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:00:50.486114 13052 mvcc.cc:205] Tried to move back new op lower bound from 7317577934720430080 to 7317577934466203648. Current Snapshot: MvccSnapshot[applied={T|T < 7317577934720430080}]
I20260812 07:00:50.506945 12120 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:00:50.507179 12120 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:00:50.510435 12120 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Sending DeleteTablet for 3 replicas of tablet 00ded6e9c8154f2d9e05215dcd37299b
I20260812 07:00:50.511538 12597 tablet_service.cc:1514] Processing DeleteTablet for tablet 00ded6e9c8154f2d9e05215dcd37299b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:00:50 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:43492
I20260812 07:00:50.511521 12867 tablet_service.cc:1514] Processing DeleteTablet for tablet 00ded6e9c8154f2d9e05215dcd37299b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:00:50 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:34878
I20260812 07:00:50.512457 12344 tablet_service.cc:1514] Processing DeleteTablet for tablet 00ded6e9c8154f2d9e05215dcd37299b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:00:50 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:34696
I20260812 07:00:50.513546 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 12234
I20260812 07:00:50.516111 13074 tablet_replica.cc:330] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: stopping tablet replica
I20260812 07:00:50.516525 13074 raft_consensus.cc:2229] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:00:50.517030 13074 raft_consensus.cc:2258] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:00:50.519395 13074 ts_tablet_manager.cc:1905] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:00:50.520735 13078 tablet_replica.cc:330] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: stopping tablet replica
I20260812 07:00:50.521152 13078 raft_consensus.cc:2229] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 1 LEADER]: Raft consensus shutting down.
I20260812 07:00:50.522513 13076 tablet_replica.cc:330] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: stopping tablet replica
I20260812 07:00:50.522871 13076 raft_consensus.cc:2229] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:00:50.523343 13076 raft_consensus.cc:2258] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:00:50.525516 13074 ts_tablet_manager.cc:1918] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:00:50.525671 13074 log.cc:1196] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/00ded6e9c8154f2d9e05215dcd37299b
I20260812 07:00:50.526206 13074 ts_tablet_manager.cc:1939] T 00ded6e9c8154f2d9e05215dcd37299b P b83b6d3b91ec45e395d4a6dae1ce7532: Deleting consensus metadata
I20260812 07:00:50.526839 13076 ts_tablet_manager.cc:1905] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:00:50.527478 13078 raft_consensus.cc:2258] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:00:50.527892 12090 catalog_manager.cc:4841] TS b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109): tablet 00ded6e9c8154f2d9e05215dcd37299b (table test-table [id=9ee1c769a64841d98c5f7087d8f2aecc]) successfully deleted
I20260812 07:00:50.530810 13078 ts_tablet_manager.cc:1905] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 07:00:50 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 07:00:50.533383 13076 ts_tablet_manager.cc:1918] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:00:50.533620 13076 log.cc:1196] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/00ded6e9c8154f2d9e05215dcd37299b
I20260812 07:00:50.534250 13076 ts_tablet_manager.cc:1939] T 00ded6e9c8154f2d9e05215dcd37299b P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Deleting consensus metadata
I20260812 07:00:50.538235 13078 ts_tablet_manager.cc:1918] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:00:50.538429 13078 log.cc:1196] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/00ded6e9c8154f2d9e05215dcd37299b
I20260812 07:00:50.538982 13078 ts_tablet_manager.cc:1939] T 00ded6e9c8154f2d9e05215dcd37299b P 6cc6467ed9574db9989e6a75b2647981: Deleting consensus metadata
I20260812 07:00:50.540697 12088 catalog_manager.cc:4841] TS 6cc6467ed9574db9989e6a75b2647981 (127.18.70.129:35997): tablet 00ded6e9c8154f2d9e05215dcd37299b (table test-table [id=9ee1c769a64841d98c5f7087d8f2aecc]) successfully deleted
I20260812 07:00:50.540988 12088 catalog_manager.cc:4841] TS 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525): tablet 00ded6e9c8154f2d9e05215dcd37299b (table test-table [id=9ee1c769a64841d98c5f7087d8f2aecc]) successfully deleted
I20260812 07:00:50.542110 13023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.514746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34722 (local address 127.18.70.129:35997)
0812 07:00:50.514918 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:50.514925 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:50.517936 (+ 3011us) server_negotiation.cc:407] Connection header received
0812 07:00:50.518193 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:50.518199 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:50.518285 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:50.518358 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:50.523740 (+ 5382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.524920 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.527882 (+ 2962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.528602 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.528701 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.534320 (+ 5619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:50.534335 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:50.534353 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:50.534397 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:50.538533 (+ 4136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:50.539480 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:50.539490 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:50.539493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:50.539673 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:50.540171 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:50.540176 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:50.540179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:50.540659 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:50.540965 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:50.541528 (+ 563us) server_negotiation.cc:299] Negotiation successful
0812 07:00:50.541755 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 07:00:50.542754 12454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:50.638682 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 12234
I20260812 07:00:50.666708 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 12479
Aug 12 07:00:50 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 07:00:50.680540 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.667445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43502 (local address 127.18.70.130:39525)
0812 07:00:50.667612 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:50.667617 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:50.667650 (+ 33us) server_negotiation.cc:407] Connection header received
0812 07:00:50.667789 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:50.667793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:50.667861 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:50.667936 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:50.669107 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.669813 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.671130 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.671546 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.671634 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.675522 (+ 3888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:50.675535 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:50.675551 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:50.675588 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:50.678150 (+ 2562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:50.678763 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:50.678770 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:50.678772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:50.678910 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:50.679191 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:50.679194 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:50.679196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:50.679556 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:50.679800 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:50.680006 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 07:00:50.680169 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 07:00:50.681159 12712 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:50.769071 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 12479
I20260812 07:00:50.796705 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 12742
Aug 12 07:00:50 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 07:00:50.810915 13024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:50.797428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34880 (local address 127.18.70.131:34109)
0812 07:00:50.797636 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:50.797640 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:50.797660 (+ 20us) server_negotiation.cc:407] Connection header received
0812 07:00:50.797810 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:50.797814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:50.797878 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:50.798088 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:50.799390 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.800113 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.801343 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:50.801725 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:50.801809 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:50.805989 (+ 4180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:50.806007 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:50.806025 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:50.806058 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:50.808450 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:50.809076 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:50.809082 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:50.809084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:50.809228 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:50.809512 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:50.809515 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:50.809517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:50.809853 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:50.810120 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:50.810421 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 07:00:50.810599 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 07:00:50.811548 12986 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:50.898315 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 12742
I20260812 07:00:50.924857 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 12066
I20260812 07:00:50.926033 12169 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:51.038146 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 12066
I20260812 07:00:51.069478 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36193
--webserver_interface=127.18.70.190
--webserver_port=43777
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:36193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:00:51.399645 13088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:51.399928 13088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:51.400058 13088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:51.407482 13088 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:00:51.407608 13088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:51.407687 13088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:51.407760 13088 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:00:51.407822 13088 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:00:51.418432 13088 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:36193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=43777
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:51.419656 13088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:51.420970 13088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:51.444247 13104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:51.444310 13106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:51.444274 13102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:51.445199 13088 server_base.cc:1034] running on GCE node
I20260812 07:00:51.446123 13088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:51.447669 13088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:51.448890 13088 hybrid_clock.cc:648] HybridClock initialized: now 1786518051448820 us; error 60 us; skew 500 ppm
I20260812 07:00:51.449273 13088 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:51 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518051, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:51.457460 13088 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:00:51.459182 13088 webserver.cc:460] Webserver started at http://127.18.70.190:43777/ using document root <none> and password file <none>
I20260812 07:00:51.459947 13088 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:51.460080 13088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:51.466132 13088 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 07:00:51.469013 13116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:51.470336 13088 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:00:51.470518 13088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "2dc7f3a5d2cc46f1b845b1d045154584"
format_stamp: "Formatted at 2026-08-12 07:00:48 on dist-test-slave-tc2s"
server_key: "8d6c220e3e7582306e24aefc7f9b9f28"
server_key_iv: "fff2c68b10f160bf15e7ce04788567b9"
server_key_version: "encryptionkey@0"
I20260812 07:00:51.471611 13088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:51.500526 13088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:51.504863 13088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:51.505172 13088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:51.524113 13088 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:36193
I20260812 07:00:51.524140 13221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:36193 every 8 connection(s)
I20260812 07:00:51.525712 13088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:00:51.532733 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 13088
I20260812 07:00:51.533713 13223 sys_catalog.cc:263] Verifying existing consensus state
I20260812 07:00:51.533828 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:35997
--local_ip_for_outbound_sockets=127.18.70.129
--tserver_master_addrs=127.18.70.190:36193
--webserver_port=44857
--webserver_interface=127.18.70.129
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:00:51.538652 13223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Bootstrap starting.
I20260812 07:00:51.561599 13223 log.cc:824] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:51.575776 13223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 07:00:51.576388 13223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Bootstrap complete.
I20260812 07:00:51.586586 13223 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:51.587637 13223 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc7f3a5d2cc46f1b845b1d045154584, State: Initialized, Role: FOLLOWER
I20260812 07:00:51.588340 13223 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:51.588570 13223 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:00:51.588692 13223 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:00:51.588879 13223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 1 FOLLOWER]: Advancing to term 2
I20260812 07:00:51.592911 13223 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:51.593420 13223 leader_election.cc:302] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2dc7f3a5d2cc46f1b845b1d045154584; no voters:
I20260812 07:00:51.594080 13223 leader_election.cc:288] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 07:00:51.594231 13229 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 07:00:51.595477 13229 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 2 LEADER]: Becoming Leader. State: Replica: 2dc7f3a5d2cc46f1b845b1d045154584, State: Running, Role: LEADER
I20260812 07:00:51.596028 13229 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:51.596597 13223 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:00:51.598596 13233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2dc7f3a5d2cc46f1b845b1d045154584. Latest consensus state: current_term: 2 leader_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } } }
I20260812 07:00:51.599224 13233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:51.598838 13230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } } }
I20260812 07:00:51.599750 13230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:51.602661 13238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:00:51.612424 13238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:00:51.613770 13238 catalog_manager.cc:1259] Loaded cluster ID: db824a1c1a6a4e2281a40416c43c18af
I20260812 07:00:51.613867 13238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:00:51.616911 13238 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 07:00:51.637038 13238 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 07:00:51.647522 13238 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:00:51.649344 13238 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Loaded TSK: 0
I20260812 07:00:51.651088 13238 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 07:00:51.904819 13226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:51.905083 13226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:51.905205 13226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:51.912300 13226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:51.912405 13226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:51.912540 13226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:00:51.921962 13226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:35997
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=44857
--tserver_master_addrs=127.18.70.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:51.923197 13226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:51.924470 13226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:51.937620 13274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:51.937685 13271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:51.938047 13226 server_base.cc:1034] running on GCE node
W20260812 07:00:51.938683 13276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:51.939332 13226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:51.940266 13226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:51.941500 13226 hybrid_clock.cc:648] HybridClock initialized: now 1786518051941449 us; error 43 us; skew 500 ppm
I20260812 07:00:51.941780 13226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:51 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518051, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:51.944789 13226 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 07:00:51.946273 13226 webserver.cc:460] Webserver started at http://127.18.70.129:44857/ using document root <none> and password file <none>
I20260812 07:00:51.946906 13226 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:51.947038 13226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:51.952276 13226 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260812 07:00:51.955090 13286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:51.956368 13226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 07:00:51.956512 13226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "6cc6467ed9574db9989e6a75b2647981"
format_stamp: "Formatted at 2026-08-12 07:00:48 on dist-test-slave-tc2s"
server_key: "693dfbf4f4524799e871b813eaf54bc8"
server_key_iv: "c733d7236bf18676856a3d809e518051"
server_key_version: "encryptionkey@0"
I20260812 07:00:51.957432 13226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:51.973047 13226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:51.977046 13226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:51.977285 13226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:51.978276 13226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:51.979652 13226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:51.979746 13226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:51.979847 13226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:51.979925 13226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:52.018184 13226 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:35997
I20260812 07:00:52.018250 13499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:35997 every 8 connection(s)
I20260812 07:00:52.019614 13226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:00:52.026654 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 13226
I20260812 07:00:52.027271 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:39525
--local_ip_for_outbound_sockets=127.18.70.130
--tserver_master_addrs=127.18.70.190:36193
--webserver_port=40405
--webserver_interface=127.18.70.130
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 07:00:52 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518051, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:52.042935 13505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.022311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:49999 (local address 127.18.70.190:36193)
0812 07:00:52.022887 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:52.022898 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:52.023443 (+ 545us) server_negotiation.cc:407] Connection header received
0812 07:00:52.025468 (+ 2025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:52.025481 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:52.025772 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:52.026159 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:52.027818 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.029633 (+ 1815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.031206 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.032133 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.032309 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:52.035651 (+ 3342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:52.035661 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:52.035679 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:52.035720 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:52.038800 (+ 3080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:52.039660 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:52.039667 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:52.039672 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:52.039846 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:52.040284 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:52.040287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:52.040289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:52.040739 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:52.040889 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:52.041702 (+ 813us) server_negotiation.cc:299] Negotiation successful
0812 07:00:52.042040 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":262,"threads_started":1}
I20260812 07:00:52.043196 13508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.022479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:49999)
0812 07:00:52.023262 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:52.023308 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:52.025037 (+ 1729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:52.026312 (+ 1275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:52.026323 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:52.026955 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:52.027573 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:52.027593 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.029772 (+ 2179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.029776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:52.031059 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:52.031072 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.032359 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.032365 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:52.032552 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:52.033177 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:52.033200 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:52.035370 (+ 2170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:52.038944 (+ 3574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:52.038953 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:52.038966 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:52.039516 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:52.039956 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:52.039960 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:52.039963 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:52.040189 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:52.040875 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:52.040882 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:52.041238 (+ 356us) client_negotiation.cc:769] Sending connection context
0812 07:00:52.041518 (+ 280us) client_negotiation.cc:240] Negotiation successful
0812 07:00:52.042088 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":323,"threads_started":1}
I20260812 07:00:52.046066 13501 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36193
I20260812 07:00:52.046347 13501 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:52.047045 13501 heartbeater.cc:511] Master 127.18.70.190:36193 requested a full tablet report, sending...
I20260812 07:00:52.049132 13157 ts_manager.cc:194] Registered new tserver with Master: 6cc6467ed9574db9989e6a75b2647981 (127.18.70.129:35997)
I20260812 07:00:52.050720 13157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:49999
W20260812 07:00:52.356531 13509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:52.356807 13509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:52.356940 13509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:52.364176 13509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:52.364289 13509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:52.364451 13509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:00:52.373799 13509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:39525
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=40405
--tserver_master_addrs=127.18.70.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:52.375072 13509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:52.376428 13509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:52.388993 13515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:52.389038 13514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:52.389072 13517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:52.390020 13509 server_base.cc:1034] running on GCE node
I20260812 07:00:52.390540 13509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:52.391337 13509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:52.392534 13509 hybrid_clock.cc:648] HybridClock initialized: now 1786518052392487 us; error 36 us; skew 500 ppm
I20260812 07:00:52.392827 13509 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:52 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:52.395810 13509 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 07:00:52.397177 13509 webserver.cc:460] Webserver started at http://127.18.70.130:40405/ using document root <none> and password file <none>
I20260812 07:00:52.397807 13509 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:52.397955 13509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:52.402978 13509 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 07:00:52.405519 13535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:52.406709 13509 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 07:00:52.406852 13509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a"
format_stamp: "Formatted at 2026-08-12 07:00:49 on dist-test-slave-tc2s"
server_key: "57a687d584c0b056fa59ab5f56bbf5c8"
server_key_iv: "b0840aff2b0a1a4529d8d60b7cd0a3a4"
server_key_version: "encryptionkey@0"
I20260812 07:00:52.407795 13509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:52.419337 13509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:52.422852 13509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:52.423091 13509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:52.423982 13509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:52.425220 13509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:52.425324 13509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:52.425424 13509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:52.425495 13509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:52.456014 13509 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:39525
I20260812 07:00:52.456077 13729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:39525 every 8 connection(s)
I20260812 07:00:52.457355 13509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:00:52.464754 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 13509
I20260812 07:00:52.465502 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:34109
--local_ip_for_outbound_sockets=127.18.70.131
--tserver_master_addrs=127.18.70.190:36193
--webserver_port=38807
--webserver_interface=127.18.70.131
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 07:00:52 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:52.476725 13505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.459627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:42231 (local address 127.18.70.190:36193)
0812 07:00:52.459842 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:52.459848 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:52.460906 (+ 1058us) server_negotiation.cc:407] Connection header received
0812 07:00:52.462831 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:52.462835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:52.462904 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:52.462994 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:52.464340 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.465358 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.466938 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.467514 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.467631 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:52.470971 (+ 3340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:52.470977 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:52.470981 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:52.471020 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:52.473829 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:52.474533 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:52.474537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:52.474540 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:52.474681 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:52.475082 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:52.475086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:52.475089 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:52.475381 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:52.475511 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:52.476293 (+ 782us) server_negotiation.cc:299] Negotiation successful
0812 07:00:52.476479 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 07:00:52.477932 13733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.460054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:42231)
0812 07:00:52.460774 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:52.460810 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:52.462606 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:52.463163 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:52.463170 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:52.463657 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:52.464202 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:52.464220 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.465513 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.465517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:52.466788 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:52.466801 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.467691 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.467695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:52.467886 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:52.468488 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:52.468518 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:52.470735 (+ 2217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:52.473975 (+ 3240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:52.473981 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:52.473991 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:52.474411 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:52.474787 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:52.474792 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:52.474796 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:52.474973 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:52.475512 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:52.475520 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:52.475910 (+ 390us) client_negotiation.cc:769] Sending connection context
0812 07:00:52.476202 (+ 292us) client_negotiation.cc:240] Negotiation successful
0812 07:00:52.476708 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":274,"threads_started":1}
I20260812 07:00:52.479305 13730 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36193
I20260812 07:00:52.479594 13730 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:52.480417 13730 heartbeater.cc:511] Master 127.18.70.190:36193 requested a full tablet report, sending...
I20260812 07:00:52.481920 13157 ts_manager.cc:194] Registered new tserver with Master: 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525)
I20260812 07:00:52.482713 13157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:42231
W20260812 07:00:52.796106 13734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:52.796341 13734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:52.796468 13734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:52.803396 13734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:52.803494 13734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:52.803649 13734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:00:52.812723 13734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:34109
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=38807
--tserver_master_addrs=127.18.70.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:52.813795 13734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:52.815018 13734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:52.826963 13742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:52.826987 13747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:52.826941 13744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:52.827562 13734 server_base.cc:1034] running on GCE node
I20260812 07:00:52.828243 13734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:52.829087 13734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:52.830278 13734 hybrid_clock.cc:648] HybridClock initialized: now 1786518052830236 us; error 29 us; skew 500 ppm
I20260812 07:00:52.830559 13734 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:52 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:52.833387 13734 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 07:00:52.834681 13734 webserver.cc:460] Webserver started at http://127.18.70.131:38807/ using document root <none> and password file <none>
I20260812 07:00:52.835286 13734 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:52.835415 13734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:52.840276 13734 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260812 07:00:52.842880 13756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:52.844002 13734 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 07:00:52.844141 13734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "b83b6d3b91ec45e395d4a6dae1ce7532"
format_stamp: "Formatted at 2026-08-12 07:00:49 on dist-test-slave-tc2s"
server_key: "6e061162391c702e81d2cbd02f236efe"
server_key_iv: "af8682c794a5528bfa869a8c51fef7e4"
server_key_version: "encryptionkey@0"
I20260812 07:00:52.845072 13734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:52.885285 13734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:52.888813 13734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:52.889052 13734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:52.889981 13734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:52.891196 13734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:52.891302 13734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:52.891409 13734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:52.891479 13734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:52.920575 13734 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:34109
I20260812 07:00:52.920645 13960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:34109 every 8 connection(s)
I20260812 07:00:52.921923 13734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:00:52.922827 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 13734
I20260812 07:00:52.937490 13505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.923867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33706 (local address 127.18.70.190:36193)
0812 07:00:52.924055 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:52.924061 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:52.924487 (+ 426us) server_negotiation.cc:407] Connection header received
0812 07:00:52.924672 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:52.924678 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:52.924747 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:52.924828 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:52.926421 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.927302 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.928653 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.929111 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.929221 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:52.932445 (+ 3224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:52.932449 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:52.932453 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:52.932482 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:52.935029 (+ 2547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:52.935687 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:52.935692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:52.935694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:52.935846 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:52.936189 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:52.936192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:52.936194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:52.936456 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:52.936705 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:52.936983 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 07:00:52.937183 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 07:00:52 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:00:52.949684 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.924414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:50507 (local address 127.18.70.190:36193)
0812 07:00:52.931235 (+ 6821us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:52.931240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:52.931255 (+ 15us) server_negotiation.cc:407] Connection header received
0812 07:00:52.932923 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:52.932929 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:52.933005 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:52.933104 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:52.935216 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.935939 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.937432 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.938036 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.938160 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:52.941463 (+ 3303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:52.941467 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:52.941470 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:52.941498 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:52.944294 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:52.945866 (+ 1572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:52.945870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:52.945872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:52.946018 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:52.946967 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:52.946987 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:52.946997 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:52.947922 (+ 925us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:52.948062 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:52.949051 (+ 989us) server_negotiation.cc:299] Negotiation successful
0812 07:00:52.949251 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6725,"thread_start_us":6619,"threads_started":1}
I20260812 07:00:52.950749 13971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.925038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:50507)
0812 07:00:52.930480 (+ 5442us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:52.930538 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:52.932680 (+ 2142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:52.934072 (+ 1392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:52.934080 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:52.934528 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:52.935043 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:52.935061 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.936083 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.936087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:52.937261 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:52.937274 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.938262 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.938270 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:52.938469 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:52.939071 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:52.939099 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:52.941268 (+ 2169us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:52.944620 (+ 3352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:52.944658 (+ 38us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:52.944740 (+ 82us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:52.945538 (+ 798us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:52.946124 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:52.946128 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:52.946130 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:52.946621 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:52.948076 (+ 1455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:52.948084 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:52.948667 (+ 583us) client_negotiation.cc:769] Sending connection context
0812 07:00:52.948911 (+ 244us) client_negotiation.cc:240] Negotiation successful
0812 07:00:52.949388 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5145,"thread_start_us":4922,"threads_started":1}
I20260812 07:00:52.952970 13964 heartbeater.cc:347] Connected to a master server at 127.18.70.190:36193
I20260812 07:00:52.953459 13964 heartbeater.cc:464] Registering TS with master...
I20260812 07:00:52.955852 13964 heartbeater.cc:511] Master 127.18.70.190:36193 requested a full tablet report, sending...
I20260812 07:00:52.958779 13157 ts_manager.cc:194] Registered new tserver with Master: b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109)
I20260812 07:00:52.959880 13157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:50507
I20260812 07:00:52.965090 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 07:00:52.971383 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.965943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33720 (local address 127.18.70.190:36193)
0812 07:00:52.966085 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:52.966089 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:52.966547 (+ 458us) server_negotiation.cc:407] Connection header received
0812 07:00:52.966735 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:52.966739 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:52.966871 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:52.966982 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:00:52.967398 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.968055 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.969467 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:52.969852 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:52.970029 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:52.970471 (+ 442us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:00:52.970862 (+ 391us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:00:52.970979 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:52.971086 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 07:00:52.971160 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 07:00:52.972146 13157 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:33720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 07:00:52.979257 13157 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 07:00:53.013520 13989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.990894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57922 (local address 127.18.70.131:34109)
0812 07:00:53.004948 (+ 14054us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:53.004955 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:53.004984 (+ 29us) server_negotiation.cc:407] Connection header received
0812 07:00:53.005064 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:53.005070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:53.005236 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:53.005413 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:53.006550 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.008089 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.010894 (+ 2805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.012377 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.012496 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.012739 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:53.013012 (+ 273us) server_negotiation.cc:299] Negotiation successful
0812 07:00:53.013176 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13887,"thread_start_us":13717,"threads_started":1}
I20260812 07:00:53.013602 13988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.990271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:34109 (local address 127.0.0.1:57922)
0812 07:00:53.004473 (+ 14202us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.004494 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:53.004614 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:53.005719 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:53.005727 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:53.005797 (+ 70us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:53.006358 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:53.006371 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.008210 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.008214 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:53.010721 (+ 2507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:53.010736 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.012567 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.012574 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:53.012751 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.012800 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 07:00:53.012925 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 07:00:53.013105 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14060,"mutex_wait_us":46,"spinlock_wait_cycles":6784,"thread_start_us":13909,"threads_started":1}
I20260812 07:00:53.014344 13991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.991609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55406 (local address 127.18.70.129:35997)
0812 07:00:53.003893 (+ 12284us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:53.003903 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:53.004680 (+ 777us) server_negotiation.cc:407] Connection header received
0812 07:00:53.004986 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:53.004995 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:53.005232 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:53.005393 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:53.006817 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.008315 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.011069 (+ 2754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.012486 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.012619 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.012797 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:53.013947 (+ 1150us) server_negotiation.cc:299] Negotiation successful
0812 07:00:53.014097 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12092,"thread_start_us":12280,"threads_started":1}
I20260812 07:00:53.014619 13990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.991251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35997 (local address 127.0.0.1:55406)
0812 07:00:53.004556 (+ 13305us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.004575 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:53.004785 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:53.005719 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:53.005727 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:53.005809 (+ 82us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:53.006676 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:53.006685 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.008440 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.008444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:53.010911 (+ 2467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:53.010925 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.012905 (+ 1980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.012912 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:53.013059 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.013088 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 07:00:53.013159 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 07:00:53.013270 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13185,"mutex_wait_us":43,"spinlock_wait_cycles":85120,"thread_start_us":13049,"threads_started":1}
I20260812 07:00:53.014686 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.989823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:39525 (local address 127.0.0.1:44982)
0812 07:00:52.990897 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:52.990938 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:52.991097 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:53.005718 (+ 14621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:53.005726 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:53.005769 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:53.006358 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:53.006371 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.009441 (+ 3070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.009447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:53.011505 (+ 2058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:53.011521 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.013318 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.013325 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:53.013525 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.013567 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 07:00:53.013641 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 07:00:53.013766 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":854,"mutex_wait_us":21,"spinlock_wait_cycles":4352,"thread_start_us":713,"threads_started":1}
I20260812 07:00:53.015416 13986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:52.990050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44982 (local address 127.18.70.130:39525)
0812 07:00:53.005176 (+ 15126us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:53.005183 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:53.005204 (+ 21us) server_negotiation.cc:407] Connection header received
0812 07:00:53.005277 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:53.005282 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:53.005470 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:53.006192 (+ 722us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:53.008296 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.009328 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.011693 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.013061 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.014174 (+ 1113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.014346 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:53.014430 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 07:00:53.015089 (+ 659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14981,"thread_start_us":14872,"threads_started":1}
I20260812 07:00:53.017340 13839 tablet_service.cc:1467] Processing CreateTablet for tablet d516b4f7a2374293b242a28a5c6a9a1f (DEFAULT_TABLE table=test-table [id=301b48e0ef5445088772653f35754807]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:00:53.018878 13839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d516b4f7a2374293b242a28a5c6a9a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:53.018787 13375 tablet_service.cc:1467] Processing CreateTablet for tablet d516b4f7a2374293b242a28a5c6a9a1f (DEFAULT_TABLE table=test-table [id=301b48e0ef5445088772653f35754807]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:00:53.018775 13629 tablet_service.cc:1467] Processing CreateTablet for tablet d516b4f7a2374293b242a28a5c6a9a1f (DEFAULT_TABLE table=test-table [id=301b48e0ef5445088772653f35754807]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:00:53.020009 13629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d516b4f7a2374293b242a28a5c6a9a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:53.020020 13375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d516b4f7a2374293b242a28a5c6a9a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:00:53.033113 13992 tablet_bootstrap.cc:492] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532: Bootstrap starting.
I20260812 07:00:53.036091 13992 tablet_bootstrap.cc:654] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:53.036862 13994 tablet_bootstrap.cc:492] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: Bootstrap starting.
I20260812 07:00:53.037320 13992 log.cc:824] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:53.040268 13994 tablet_bootstrap.cc:654] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:53.040449 13992 tablet_bootstrap.cc:492] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532: No bootstrap required, opened a new log
I20260812 07:00:53.040719 13992 ts_tablet_manager.cc:1397] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260812 07:00:53.040845 13993 tablet_bootstrap.cc:492] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Bootstrap starting.
I20260812 07:00:53.041841 13994 log.cc:824] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:53.043706 13993 tablet_bootstrap.cc:654] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Neither blocks nor log segments found. Creating new log.
I20260812 07:00:53.044613 13993 log.cc:824] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:53.044783 13994 tablet_bootstrap.cc:492] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: No bootstrap required, opened a new log
I20260812 07:00:53.045027 13994 ts_tablet_manager.cc:1397] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 07:00:53.046818 13993 tablet_bootstrap.cc:492] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a: No bootstrap required, opened a new log
I20260812 07:00:53.047034 13993 ts_tablet_manager.cc:1397] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 07:00:53.050640 13992 raft_consensus.cc:348] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:53.051055 13992 raft_consensus.cc:374] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:53.051154 13992 raft_consensus.cc:729] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83b6d3b91ec45e395d4a6dae1ce7532, State: Initialized, Role: FOLLOWER
I20260812 07:00:53.051729 13992 consensus_queue.cc:260] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:53.052770 13964 heartbeater.cc:503] Master 127.18.70.190:36193 was elected leader, sending a full tablet report...
I20260812 07:00:53.053350 13992 ts_tablet_manager.cc:1428] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532: Time spent starting tablet: real 0.012s user 0.010s sys 0.001s
I20260812 07:00:53.053377 13501 heartbeater.cc:503] Master 127.18.70.190:36193 was elected leader, sending a full tablet report...
I20260812 07:00:53.054778 13993 raft_consensus.cc:348] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:53.055239 13993 raft_consensus.cc:374] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:53.055382 13993 raft_consensus.cc:729] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aaf3457ba9d4bbba3cf4561ac9eea9a, State: Initialized, Role: FOLLOWER
I20260812 07:00:53.056052 13993 consensus_queue.cc:260] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:53.056257 13994 raft_consensus.cc:348] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:53.056700 13994 raft_consensus.cc:374] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:00:53.056842 13994 raft_consensus.cc:729] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6467ed9574db9989e6a75b2647981, State: Initialized, Role: FOLLOWER
I20260812 07:00:53.057175 13730 heartbeater.cc:503] Master 127.18.70.190:36193 was elected leader, sending a full tablet report...
I20260812 07:00:53.057624 13993 ts_tablet_manager.cc:1428] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260812 07:00:53.057452 13994 consensus_queue.cc:260] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:53.059500 13994 ts_tablet_manager.cc:1428] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: Time spent starting tablet: real 0.014s user 0.006s sys 0.006s
I20260812 07:00:53.110976 14003 raft_consensus.cc:482] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:00:53.111236 14003 raft_consensus.cc:504] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:53.112838 14003 leader_election.cc:288] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525), 6cc6467ed9574db9989e6a75b2647981 (127.18.70.129:35997)
I20260812 07:00:53.119262 13986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.113136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:47205 (local address 127.18.70.130:39525)
0812 07:00:53.113316 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:53.113322 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:53.113343 (+ 21us) server_negotiation.cc:407] Connection header received
0812 07:00:53.113518 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:53.113523 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:53.113606 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:53.113693 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:53.114368 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.115368 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.117293 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.118519 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.118624 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.118678 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:53.118983 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 07:00:53.119074 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 07:00:53.119372 13971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.113025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:39525 (local address 127.18.70.131:47205)
0812 07:00:53.113189 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.113208 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:53.113319 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:53.113881 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:53.113919 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:53.113956 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:53.114207 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:53.114220 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.115504 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.115509 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:53.117128 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:53.117142 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.118652 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.118658 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:53.118840 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.118874 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 07:00:53.118978 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 07:00:53.119112 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 07:00:53.120261 13991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.113616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:58543 (local address 127.18.70.129:35997)
0812 07:00:53.113806 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:53.113812 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:53.114520 (+ 708us) server_negotiation.cc:407] Connection header received
0812 07:00:53.114668 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:53.114671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:53.114727 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:53.114791 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:00:53.115344 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.116356 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.118436 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.119551 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.119680 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.119746 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:53.120006 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 07:00:53.120092 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 07:00:53.120477 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.113379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35997 (local address 127.18.70.131:58543)
0812 07:00:53.114407 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.114426 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:53.114556 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:53.114830 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:53.114835 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:53.114861 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:00:53.115205 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:53.115216 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.116498 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.116503 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:53.118287 (+ 1784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:53.118303 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.119736 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.119740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:53.119855 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.119877 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 07:00:53.119972 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 07:00:53.120103 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":888,"mutex_wait_us":1,"thread_start_us":657,"threads_started":1}
I20260812 07:00:53.120411 13657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d516b4f7a2374293b242a28a5c6a9a1f" candidate_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" is_pre_election: true
I20260812 07:00:53.120944 13657 raft_consensus.cc:2454] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83b6d3b91ec45e395d4a6dae1ce7532 in term 0.
I20260812 07:00:53.121440 13419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d516b4f7a2374293b242a28a5c6a9a1f" candidate_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6467ed9574db9989e6a75b2647981" is_pre_election: true
I20260812 07:00:53.121613 13758 leader_election.cc:302] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4aaf3457ba9d4bbba3cf4561ac9eea9a, b83b6d3b91ec45e395d4a6dae1ce7532; no voters:
I20260812 07:00:53.121860 13419 raft_consensus.cc:2454] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83b6d3b91ec45e395d4a6dae1ce7532 in term 0.
I20260812 07:00:53.121985 14003 raft_consensus.cc:2781] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:00:53.122120 14003 raft_consensus.cc:482] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:00:53.122203 14003 raft_consensus.cc:3037] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:53.124358 14003 raft_consensus.cc:504] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:53.124897 14003 leader_election.cc:288] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [CANDIDATE]: Term 1 election: Requested vote from peers 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525), 6cc6467ed9574db9989e6a75b2647981 (127.18.70.129:35997)
I20260812 07:00:53.125280 13657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d516b4f7a2374293b242a28a5c6a9a1f" candidate_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a"
I20260812 07:00:53.125320 13419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d516b4f7a2374293b242a28a5c6a9a1f" candidate_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6467ed9574db9989e6a75b2647981"
I20260812 07:00:53.125447 13657 raft_consensus.cc:3037] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:53.125468 13419 raft_consensus.cc:3037] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:00:53.127622 13419 raft_consensus.cc:2454] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83b6d3b91ec45e395d4a6dae1ce7532 in term 1.
I20260812 07:00:53.127774 13657 raft_consensus.cc:2454] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83b6d3b91ec45e395d4a6dae1ce7532 in term 1.
I20260812 07:00:53.127969 13758 leader_election.cc:302] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6467ed9574db9989e6a75b2647981, b83b6d3b91ec45e395d4a6dae1ce7532; no voters:
I20260812 07:00:53.128222 14003 raft_consensus.cc:2781] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:00:53.128616 14003 raft_consensus.cc:686] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 1 LEADER]: Becoming Leader. State: Replica: b83b6d3b91ec45e395d4a6dae1ce7532, State: Running, Role: LEADER
I20260812 07:00:53.129032 14003 consensus_queue.cc:237] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:53.133001 13157 catalog_manager.cc:5495] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131). New cstate: current_term: 1 leader_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } health_report { overall_health: UNKNOWN } } }
I20260812 07:00:53.154464 13989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.149744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57928 (local address 127.18.70.131:34109)
0812 07:00:53.149946 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:53.149952 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:53.150040 (+ 88us) server_negotiation.cc:407] Connection header received
0812 07:00:53.150195 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:53.150198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:53.150274 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:53.150380 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:00:53.150721 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.151437 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.152711 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.153086 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.153168 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.153561 (+ 393us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:00:53.154027 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:00:53.154126 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:53.154190 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 07:00:53.154247 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 07:00:53.161803 13419 raft_consensus.cc:1261] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Refusing update from remote peer b83b6d3b91ec45e395d4a6dae1ce7532: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:00:53.161841 13657 raft_consensus.cc:1261] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 1 FOLLOWER]: Refusing update from remote peer b83b6d3b91ec45e395d4a6dae1ce7532: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:00:53.162639 14007 consensus_queue.cc:1035] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:00:53.162952 14003 consensus_queue.cc:1035] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:00:53.185595 13157 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:33720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:00:53.185851 13157 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:33720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:00:53.189172 13157 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Sending DeleteTablet for 3 replicas of tablet d516b4f7a2374293b242a28a5c6a9a1f
I20260812 07:00:53.190140 13629 tablet_service.cc:1514] Processing DeleteTablet for tablet d516b4f7a2374293b242a28a5c6a9a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:00:53 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:44982
I20260812 07:00:53.190270 13839 tablet_service.cc:1514] Processing DeleteTablet for tablet d516b4f7a2374293b242a28a5c6a9a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:00:53 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:57922
I20260812 07:00:53.190491 13375 tablet_service.cc:1514] Processing DeleteTablet for tablet d516b4f7a2374293b242a28a5c6a9a1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:00:53 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:55406
I20260812 07:00:53.191152 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 13226
I20260812 07:00:53.210408 13991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.192191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55410 (local address 127.18.70.129:35997)
0812 07:00:53.192354 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:53.192360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:53.192379 (+ 19us) server_negotiation.cc:407] Connection header received
0812 07:00:53.192436 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:53.192441 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:53.192514 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:53.192628 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:53.194436 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.195617 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.197736 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.198504 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.198628 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.202250 (+ 3622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:53.202263 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:53.202280 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:53.202314 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:53.206070 (+ 3756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:53.206909 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:53.206917 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:53.206921 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:53.207079 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:53.207465 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:53.207470 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:53.207474 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:53.207929 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:53.208248 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:53.208532 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 07:00:53.208775 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 07:00:53.211375 13494 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:53.222805 14037 tablet_replica.cc:330] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532: stopping tablet replica
I20260812 07:00:53.223315 14037 raft_consensus.cc:2229] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 1 LEADER]: Raft consensus shutting down.
I20260812 07:00:53.224119 14037 raft_consensus.cc:2258] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:00:53.225179 14035 tablet_replica.cc:330] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a: stopping tablet replica
I20260812 07:00:53.225651 14035 raft_consensus.cc:2229] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:00:53.226545 14035 raft_consensus.cc:2258] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:00:53.227967 14037 ts_tablet_manager.cc:1905] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:00:53.228871 14035 ts_tablet_manager.cc:1905] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:00:53.235455 14037 ts_tablet_manager.cc:1918] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:00:53.235699 14037 log.cc:1196] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/d516b4f7a2374293b242a28a5c6a9a1f
I20260812 07:00:53.235839 14035 ts_tablet_manager.cc:1918] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:00:53.236063 14035 log.cc:1196] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/d516b4f7a2374293b242a28a5c6a9a1f
I20260812 07:00:53.236353 14037 ts_tablet_manager.cc:1939] T d516b4f7a2374293b242a28a5c6a9a1f P b83b6d3b91ec45e395d4a6dae1ce7532: Deleting consensus metadata
I20260812 07:00:53.236605 14035 ts_tablet_manager.cc:1939] T d516b4f7a2374293b242a28a5c6a9a1f P 4aaf3457ba9d4bbba3cf4561ac9eea9a: Deleting consensus metadata
I20260812 07:00:53.238102 13123 catalog_manager.cc:4841] TS b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109): tablet d516b4f7a2374293b242a28a5c6a9a1f (table test-table [id=301b48e0ef5445088772653f35754807]) successfully deleted
I20260812 07:00:53.238245 13121 catalog_manager.cc:4841] TS 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525): tablet d516b4f7a2374293b242a28a5c6a9a1f (table test-table [id=301b48e0ef5445088772653f35754807]) successfully deleted
I20260812 07:00:53.320262 14038 tablet_replica.cc:330] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: stopping tablet replica
I20260812 07:00:53.320590 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 13226
I20260812 07:00:53.351269 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 13509
W20260812 07:00:53.351301 13121 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.70.129:35997 (error 108)
I20260812 07:00:53.354475 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.353980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35997 (local address 127.0.0.1:55416)
0812 07:00:53.354165 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.354291 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 07:00:53.354772 13121 catalog_manager.cc:4584] TS 6cc6467ed9574db9989e6a75b2647981 (127.18.70.129:35997): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d516b4f7a2374293b242a28a5c6a9a1f: Network error: Client connection negotiation failed: client connection to 127.18.70.129:35997: connect: Connection refused (error 111)
I20260812 07:00:53.368266 13986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.354004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44994 (local address 127.18.70.130:39525)
0812 07:00:53.354190 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:53.354196 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:53.354216 (+ 20us) server_negotiation.cc:407] Connection header received
0812 07:00:53.354285 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:53.354289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:53.354367 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:53.354475 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:53.356301 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.357042 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.359138 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.359514 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.359605 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.362840 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:53.362854 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:53.362867 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:53.362917 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:53.365563 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:53.366434 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:53.366441 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:53.366443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:53.366567 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:53.366934 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:53.366937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:53.366939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:53.367298 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:53.367516 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:53.367836 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 07:00:53.367997 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 07:00:53.368848 13723 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:53.409174 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.408431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35997 (local address 127.0.0.1:55426)
0812 07:00:53.408725 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.408899 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 07:00:53.411695 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.410945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35997 (local address 127.0.0.1:55442)
0812 07:00:53.411348 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.411500 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220}
I20260812 07:00:53.462579 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 13509
I20260812 07:00:53.472354 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.471825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35997 (local address 127.0.0.1:55454)
0812 07:00:53.472044 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.472156 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 07:00:53.473507 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.473113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35997 (local address 127.0.0.1:55456)
0812 07:00:53.473275 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.473363 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 07:00:53.486214 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 13734
I20260812 07:00:53.500075 13989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.487063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57934 (local address 127.18.70.131:34109)
0812 07:00:53.487252 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:53.487258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:53.487276 (+ 18us) server_negotiation.cc:407] Connection header received
0812 07:00:53.487339 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:53.487342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:53.487427 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:53.487518 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:53.488880 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.489708 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.491121 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:53.491572 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:53.491680 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:53.494274 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:53.494286 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:53.494305 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:53.494351 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:53.497309 (+ 2958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:53.497977 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:53.497990 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:53.497993 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:53.498198 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:53.498581 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:53.498585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:53.498587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:53.498931 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:53.499242 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:53.499508 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 07:00:53.499724 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 07:00:53.500849 13953 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:53.554219 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.553784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35997 (local address 127.0.0.1:55468)
0812 07:00:53.553993 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.554078 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 07:00:53.555189 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.554816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35997 (local address 127.0.0.1:55476)
0812 07:00:53.555012 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.555082 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 07:00:53.633096 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 13734
I20260812 07:00:53.663460 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 13088
I20260812 07:00:53.664587 13213 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:00:53.775061 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:53.774495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:35997 (local address 127.0.0.1:55488)
0812 07:00:53.774705 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:53.774804 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 07:00:53.775364 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 13088
I20260812 07:00:53.805697 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36193
--webserver_interface=127.18.70.190
--webserver_port=43777
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:36193
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:00:54.139330 14045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:54.139839 14045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:54.139976 14045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:54.149336 14045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:00:54.149430 14045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:54.149582 14045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:54.149991 14045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:00:54.150166 14045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:00:54.160204 14045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:36193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:36193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=43777
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:54.161438 14045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:54.162703 14045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:54.173564 14053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:54.173535 14054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:54.173605 14059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:54.174350 14045 server_base.cc:1034] running on GCE node
I20260812 07:00:54.175216 14045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:54.176538 14045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:54.177743 14045 hybrid_clock.cc:648] HybridClock initialized: now 1786518054177692 us; error 34 us; skew 500 ppm
I20260812 07:00:54.178095 14045 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:54 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518054, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:54.180987 14045 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:00:54.182417 14045 webserver.cc:460] Webserver started at http://127.18.70.190:43777/ using document root <none> and password file <none>
I20260812 07:00:54.183054 14045 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:54.183172 14045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:54.188351 14045 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 07:00:54.190948 14076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:54.192091 14045 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 07:00:54.192246 14045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "2dc7f3a5d2cc46f1b845b1d045154584"
format_stamp: "Formatted at 2026-08-12 07:00:48 on dist-test-slave-tc2s"
server_key: "8d6c220e3e7582306e24aefc7f9b9f28"
server_key_iv: "fff2c68b10f160bf15e7ce04788567b9"
server_key_version: "encryptionkey@0"
I20260812 07:00:54.193183 14045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:54.203655 14045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:54.207077 14045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:54.207327 14045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:54.224301 14045 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:36193
I20260812 07:00:54.224318 14167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:36193 every 8 connection(s)
I20260812 07:00:54.225656 14045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:00:54.227968 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 14045
I20260812 07:00:54.228771 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:35997
--local_ip_for_outbound_sockets=127.18.70.129
--tserver_master_addrs=127.18.70.190:36193
--webserver_port=44857
--webserver_interface=127.18.70.129
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:00:54.232195 14170 sys_catalog.cc:263] Verifying existing consensus state
I20260812 07:00:54.235353 14170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Bootstrap starting.
I20260812 07:00:54.254832 14170 log.cc:824] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:54.270531 14170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 07:00:54.271001 14170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584: Bootstrap complete.
I20260812 07:00:54.279572 14170 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:54.280405 14170 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc7f3a5d2cc46f1b845b1d045154584, State: Initialized, Role: FOLLOWER
I20260812 07:00:54.280953 14170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:54.281164 14170 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:00:54.281271 14170 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:00:54.281428 14170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 2 FOLLOWER]: Advancing to term 3
I20260812 07:00:54.284974 14170 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:54.285414 14170 leader_election.cc:302] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2dc7f3a5d2cc46f1b845b1d045154584; no voters:
I20260812 07:00:54.286073 14170 leader_election.cc:288] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 07:00:54.286213 14180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 07:00:54.287258 14180 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [term 3 LEADER]: Becoming Leader. State: Replica: 2dc7f3a5d2cc46f1b845b1d045154584, State: Running, Role: LEADER
I20260812 07:00:54.287793 14180 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } }
I20260812 07:00:54.288105 14170 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:00:54.290199 14181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } } }
I20260812 07:00:54.290584 14181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:54.290853 14183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2dc7f3a5d2cc46f1b845b1d045154584. Latest consensus state: current_term: 3 leader_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc7f3a5d2cc46f1b845b1d045154584" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 36193 } } }
I20260812 07:00:54.291210 14183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dc7f3a5d2cc46f1b845b1d045154584 [sys.catalog]: This master's current role is: LEADER
I20260812 07:00:54.295760 14190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:00:54.304654 14190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:00:54.306134 14190 catalog_manager.cc:1259] Loaded cluster ID: db824a1c1a6a4e2281a40416c43c18af
I20260812 07:00:54.306279 14190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 07:00:54.308382 14190 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f55285da9ad google::LogMessage::Fail() at ??:0
@ 0x7f55285dd88a google::LogMessage::SendToLog() at ??:0
@ 0x7f55285da4de google::LogMessage::Flush() at ??:0
@ 0x7f55285dba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260812 07:00:54.317584 14212 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f553e00d512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f553e00a976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f553e092610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f553e092439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f552b226345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f552b22991c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f552b229799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f552b204eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f552e4de6db start_thread at ??:0
@ 0x7f552747461f clone at ??:0
W20260812 07:00:54.611594 14175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:54.611841 14175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:54.611931 14175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:54.618912 14175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:54.619002 14175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:54.619117 14175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:00:54.628373 14175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:35997
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=44857
--tserver_master_addrs=127.18.70.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:54.629441 14175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:54.630635 14175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:54.642700 14244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:54.642779 14251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:54.642755 14245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:54.643582 14175 server_base.cc:1034] running on GCE node
I20260812 07:00:54.644090 14175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:54.644897 14175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:54.646081 14175 hybrid_clock.cc:648] HybridClock initialized: now 1786518054646040 us; error 30 us; skew 500 ppm
I20260812 07:00:54.646378 14175 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:54 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518054, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:54.649338 14175 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 07:00:54.650689 14175 webserver.cc:460] Webserver started at http://127.18.70.129:44857/ using document root <none> and password file <none>
I20260812 07:00:54.651324 14175 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:54.651445 14175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:54.656421 14175 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260812 07:00:54.661041 14264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:54.662236 14175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 07:00:54.662406 14175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "6cc6467ed9574db9989e6a75b2647981"
format_stamp: "Formatted at 2026-08-12 07:00:48 on dist-test-slave-tc2s"
server_key: "693dfbf4f4524799e871b813eaf54bc8"
server_key_iv: "c733d7236bf18676856a3d809e518051"
server_key_version: "encryptionkey@0"
I20260812 07:00:54.663290 14175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:54.677700 14175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:54.681149 14175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:54.681385 14175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:54.682281 14175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:54.683890 14278 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 07:00:54.689108 14175 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 07:00:54.689219 14175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260812 07:00:54.689332 14175 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 07:00:54.692322 14175 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 07:00:54.692407 14175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20260812 07:00:54.692695 14278 tablet_bootstrap.cc:492] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: Bootstrap starting.
I20260812 07:00:54.718528 14278 log.cc:824] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: Log is configured to *not* fsync() on all Append() calls
I20260812 07:00:54.728386 14175 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:35997
I20260812 07:00:54.728438 14490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:35997 every 8 connection(s)
I20260812 07:00:54.729588 14175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:00:54.730881 14278 tablet_bootstrap.cc:492] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 07:00:54.731480 14278 tablet_bootstrap.cc:492] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: Bootstrap complete.
I20260812 07:00:54.732633 14278 ts_tablet_manager.cc:1397] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: Time spent bootstrapping tablet: real 0.040s user 0.024s sys 0.012s
I20260812 07:00:54.734289 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:54.732250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:45877)
0812 07:00:54.733094 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:54.733397 (+ 303us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":361,"threads_started":1}
W20260812 07:00:54.734987 14491 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:36193 (0 consecutive failures): Network error: Failed to ping master at 127.18.70.190:36193: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
I20260812 07:00:54.735307 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 14175
I20260812 07:00:54.735948 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:54.735549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:59947)
0812 07:00:54.735717 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:54.735803 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 07:00:54.736040 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:39525
--local_ip_for_outbound_sockets=127.18.70.130
--tserver_master_addrs=127.18.70.190:36193
--webserver_port=40405
--webserver_interface=127.18.70.130
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:00:54.737046 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:54.736590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:33119)
0812 07:00:54.736780 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:54.736879 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260812 07:00:54.737337 14491 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 07:00:54.739692 14278 raft_consensus.cc:348] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:54.740518 14278 raft_consensus.cc:729] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6467ed9574db9989e6a75b2647981, State: Initialized, Role: FOLLOWER
I20260812 07:00:54.741044 14278 consensus_queue.cc:260] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:54.742522 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:54.742181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:46445)
0812 07:00:54.742314 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:54.742391 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 07:00:54.742527 14278 ts_tablet_manager.cc:1428] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981: Time spent starting tablet: real 0.010s user 0.008s sys 0.004s
I20260812 07:00:54.743435 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:54.743102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:33847)
0812 07:00:54.743223 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:54.743294 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 07:00:55.056363 14498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:55.056623 14498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:55.056715 14498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:55.063653 14498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:55.063750 14498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:55.063864 14498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:00:55.073113 14498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:39525
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=40405
--tserver_master_addrs=127.18.70.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:55.074178 14498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:55.075327 14498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:55.087424 14509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:55.087460 14511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:55.087378 14513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:55.088316 14498 server_base.cc:1034] running on GCE node
I20260812 07:00:55.088857 14498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:55.089694 14498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:55.090880 14498 hybrid_clock.cc:648] HybridClock initialized: now 1786518055090823 us; error 62 us; skew 500 ppm
I20260812 07:00:55.091161 14498 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:55 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:55.094115 14498 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 07:00:55.095363 14498 webserver.cc:460] Webserver started at http://127.18.70.130:40405/ using document root <none> and password file <none>
I20260812 07:00:55.095953 14498 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:55.096066 14498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:55.100937 14498 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 07:00:55.103456 14528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:55.104660 14498 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 07:00:55.104789 14498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a"
format_stamp: "Formatted at 2026-08-12 07:00:49 on dist-test-slave-tc2s"
server_key: "57a687d584c0b056fa59ab5f56bbf5c8"
server_key_iv: "b0840aff2b0a1a4529d8d60b7cd0a3a4"
server_key_version: "encryptionkey@0"
I20260812 07:00:55.105651 14498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:55.120556 14498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:55.124269 14498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:55.124471 14498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:55.125285 14498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:55.126458 14498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:55.126550 14498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:55.126622 14498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:55.126680 14498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:55.156493 14498 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:39525
I20260812 07:00:55.156563 14715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:39525 every 8 connection(s)
I20260812 07:00:55.157807 14498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:00:55.160099 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 14498
I20260812 07:00:55.160696 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:34109
--local_ip_for_outbound_sockets=127.18.70.131
--tserver_master_addrs=127.18.70.190:36193
--webserver_port=38807
--webserver_interface=127.18.70.131
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:38189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:00:55.162619 14727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:55.160572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:58803)
0812 07:00:55.161441 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:55.161681 (+ 240us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":393,"threads_started":1}
W20260812 07:00:55.163239 14723 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:36193 (0 consecutive failures): Network error: Failed to ping master at 127.18.70.190:36193: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
I20260812 07:00:55.164007 14727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:55.163704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:43911)
0812 07:00:55.163828 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:55.163900 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 07:00:55.164799 14727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:55.164486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:48907)
0812 07:00:55.164620 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:55.164692 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 07:00:55.165024 14723 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 07:00:55.481693 14729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:00:55.481947 14729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:00:55.482045 14729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:00:55.488986 14729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:00:55.489078 14729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:00:55.489188 14729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:00:55.498369 14729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:38189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:34109
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=38807
--tserver_master_addrs=127.18.70.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:00:55.499421 14729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:00:55.500615 14729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:00:55.512758 14738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:55.512809 14736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:00:55.512835 14735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:00:55.515048 14729 server_base.cc:1034] running on GCE node
I20260812 07:00:55.515583 14729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:00:55.516390 14729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:00:55.517581 14729 hybrid_clock.cc:648] HybridClock initialized: now 1786518055517534 us; error 39 us; skew 500 ppm
I20260812 07:00:55.517869 14729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:00:55 dist-test-slave-tc2s krb5kdc[12035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:00:55.520947 14729 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 07:00:55.522418 14729 webserver.cc:460] Webserver started at http://127.18.70.131:38807/ using document root <none> and password file <none>
I20260812 07:00:55.523052 14729 fs_manager.cc:359] Metadata directory not provided
I20260812 07:00:55.523164 14729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:00:55.528075 14729 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 07:00:55.530591 14749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:55.531771 14729 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 07:00:55.531920 14729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "b83b6d3b91ec45e395d4a6dae1ce7532"
format_stamp: "Formatted at 2026-08-12 07:00:49 on dist-test-slave-tc2s"
server_key: "6e061162391c702e81d2cbd02f236efe"
server_key_iv: "af8682c794a5528bfa869a8c51fef7e4"
server_key_version: "encryptionkey@0"
I20260812 07:00:55.532855 14729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:00:55.543941 14729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:00:55.547467 14729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:00:55.547699 14729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:00:55.548563 14729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:00:55.549813 14729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:00:55.549939 14729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:55.550041 14729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:00:55.550113 14729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:00:55.581243 14729 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:34109
I20260812 07:00:55.581306 14948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:34109 every 8 connection(s)
I20260812 07:00:55.582617 14729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:00:55.583880 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 14729
I20260812 07:00:55.587189 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:55.585312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:48571)
0812 07:00:55.586129 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:55.586363 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":329,"threads_started":1}
W20260812 07:00:55.587775 14949 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:36193 (0 consecutive failures): Network error: Failed to ping master at 127.18.70.190:36193: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
I20260812 07:00:55.588467 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:55.588190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:43831)
0812 07:00:55.588303 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:55.588363 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 07:00:55.589148 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:55.588882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:59931)
0812 07:00:55.588981 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:55.589052 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 07:00:55.589339 14949 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 07:00:55.744884 14956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:55.744145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:39247)
0812 07:00:55.744564 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:55.744681 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":195,"threads_started":1}
I20260812 07:00:55.903477 14957 raft_consensus.cc:482] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:00:55.903751 14957 raft_consensus.cc:504] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:55.905308 14957 leader_election.cc:288] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525), b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109)
Aug 12 07:00:55 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518054, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
Aug 12 07:00:55 dist-test-slave-tc2s krb5kdc[12035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518054, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 07:00:55.926618 14958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:55.905679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:34109 (local address 127.18.70.129:35681)
0812 07:00:55.907755 (+ 2076us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:55.907770 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:55.907891 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:55.911420 (+ 3529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:55.911423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:55.911929 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:55.912257 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:55.912267 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:55.913783 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:55.913787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:55.915191 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:55.915203 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:55.916140 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:55.916147 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:55.916403 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:55.917170 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:55.917187 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:55.920095 (+ 2908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:55.923484 (+ 3389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:55.923488 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:55.923490 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:55.923916 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:55.924368 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:55.924372 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:55.924376 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:55.924538 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:55.925259 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:55.925262 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:55.925409 (+ 147us) client_negotiation.cc:769] Sending connection context
0812 07:00:55.925631 (+ 222us) client_negotiation.cc:240] Negotiation successful
0812 07:00:55.926160 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1940,"mutex_wait_us":107,"spinlock_wait_cycles":36864,"thread_start_us":1812,"threads_started":1}
I20260812 07:00:55.926659 14960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:55.905824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:50491 (local address 127.18.70.130:39525)
0812 07:00:55.907539 (+ 1715us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:55.907554 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:55.907597 (+ 43us) server_negotiation.cc:407] Connection header received
0812 07:00:55.910074 (+ 2477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:55.910084 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:55.910517 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:55.910859 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:55.912414 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:55.913598 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:55.915335 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:55.915940 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:55.916108 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:55.920067 (+ 3959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:55.920074 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:55.920086 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:55.920119 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:55.922812 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:55.923687 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:55.923696 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:55.923703 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:55.923906 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:55.924364 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:55.924369 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:55.924372 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:55.924914 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:55.925053 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:55.925880 (+ 827us) server_negotiation.cc:299] Negotiation successful
0812 07:00:55.926258 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1538,"thread_start_us":1443,"threads_started":1}
I20260812 07:00:55.926712 14956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:55.905502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:39525 (local address 127.18.70.129:50491)
0812 07:00:55.905772 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:55.905805 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 07:00:55.906439 (+ 634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:00:55.910962 (+ 4523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:00:55.910969 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:00:55.911550 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:00:55.912224 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:55.912246 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:55.913792 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:55.913796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:55.915200 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:00:55.915213 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:00:55.916209 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:00:55.916219 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:00:55.916406 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:55.917101 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:00:55.917123 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:00:55.919792 (+ 2669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:00:55.922952 (+ 3160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:55.922961 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:55.922975 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:55.923555 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:55.924024 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:00:55.924029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:00:55.924032 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:00:55.924261 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:00:55.925054 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:00:55.925062 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:00:55.925410 (+ 348us) client_negotiation.cc:769] Sending connection context
0812 07:00:55.925631 (+ 221us) client_negotiation.cc:240] Negotiation successful
0812 07:00:55.926307 (+ 676us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":347,"spinlock_wait_cycles":13312}
I20260812 07:00:55.926667 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:55.906077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:35681 (local address 127.18.70.131:34109)
0812 07:00:55.907324 (+ 1247us) server_negotiation.cc:206] Beginning negotiation
0812 07:00:55.907340 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 07:00:55.907866 (+ 526us) server_negotiation.cc:407] Connection header received
0812 07:00:55.910059 (+ 2193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:00:55.910070 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:00:55.910523 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:00:55.910859 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:00:55.912427 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:55.913611 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:55.915322 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:00:55.915940 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:00:55.916101 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:00:55.920339 (+ 4238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:00:55.920352 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:00:55.920363 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:00:55.920397 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:00:55.923358 (+ 2961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:55.924045 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:55.924053 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:55.924060 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:55.924253 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:00:55.924642 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:00:55.924645 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:00:55.924647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:00:55.925137 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:00:55.925315 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 07:00:55.925929 (+ 614us) server_negotiation.cc:299] Negotiation successful
0812 07:00:55.926246 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1035,"thread_start_us":836,"threads_started":1}
W20260812 07:00:55.930008 14266 leader_election.cc:341] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525): Not found: Tablet not found: d516b4f7a2374293b242a28a5c6a9a1f
W20260812 07:00:55.930847 14268 leader_election.cc:341] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109): Not found: Tablet not found: d516b4f7a2374293b242a28a5c6a9a1f
I20260812 07:00:55.930963 14268 leader_election.cc:302] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc6467ed9574db9989e6a75b2647981; no voters: 4aaf3457ba9d4bbba3cf4561ac9eea9a, b83b6d3b91ec45e395d4a6dae1ce7532
I20260812 07:00:55.931301 14957 raft_consensus.cc:2726] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 07:00:56.166370 14964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:56.165475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:60091)
0812 07:00:56.165980 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:56.166144 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":204,"threads_started":1}
I20260812 07:00:56.590538 14969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:56.589801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:45055)
0812 07:00:56.590233 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:56.590344 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":217,"threads_started":1}
I20260812 07:00:56.746308 14971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:56.745621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:57281)
0812 07:00:56.746064 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:56.746145 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":214,"threads_started":1}
I20260812 07:00:57.168092 14972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:57.167279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:37245)
0812 07:00:57.167806 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:57.167919 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":295,"threads_started":1}
I20260812 07:00:57.592110 14973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:57.591412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:34283)
0812 07:00:57.591841 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:57.591923 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":224,"threads_started":1}
I20260812 07:00:57.747982 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:57.747100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:33773)
0812 07:00:57.747685 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:57.747776 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":264,"threads_started":1}
I20260812 07:00:57.930454 14975 raft_consensus.cc:482] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:00:57.930650 14975 raft_consensus.cc:504] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:57.931246 14975 leader_election.cc:288] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525), b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109)
W20260812 07:00:57.932379 14268 leader_election.cc:341] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109): Not found: Tablet not found: d516b4f7a2374293b242a28a5c6a9a1f
W20260812 07:00:57.932549 14266 leader_election.cc:341] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525): Not found: Tablet not found: d516b4f7a2374293b242a28a5c6a9a1f
I20260812 07:00:57.932698 14266 leader_election.cc:302] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc6467ed9574db9989e6a75b2647981; no voters: 4aaf3457ba9d4bbba3cf4561ac9eea9a, b83b6d3b91ec45e395d4a6dae1ce7532
I20260812 07:00:57.932993 14975 raft_consensus.cc:2726] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 07:00:58.169623 14976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:58.168930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:36231)
0812 07:00:58.169377 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:58.169455 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":230,"threads_started":1}
I20260812 07:00:58.593593 14977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:58.592950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:46131)
0812 07:00:58.593357 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:58.593441 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":209,"threads_started":1}
I20260812 07:00:58.749464 14978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:58.748759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:45585)
0812 07:00:58.749225 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:58.749310 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":230,"threads_started":1}
I20260812 07:00:59.171080 14980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:59.170411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:55169)
0812 07:00:59.170820 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:59.170896 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":200,"threads_started":1}
I20260812 07:00:59.595139 14982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:59.594426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:34261)
0812 07:00:59.594860 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:59.594949 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":196,"threads_started":1}
I20260812 07:00:59.675892 14983 raft_consensus.cc:482] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:00:59.676080 14983 raft_consensus.cc:504] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:00:59.676693 14983 leader_election.cc:288] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525), b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109)
W20260812 07:00:59.677559 14266 leader_election.cc:341] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525): Not found: Tablet not found: d516b4f7a2374293b242a28a5c6a9a1f
W20260812 07:00:59.677719 14268 leader_election.cc:341] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109): Not found: Tablet not found: d516b4f7a2374293b242a28a5c6a9a1f
I20260812 07:00:59.677834 14268 leader_election.cc:302] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc6467ed9574db9989e6a75b2647981; no voters: 4aaf3457ba9d4bbba3cf4561ac9eea9a, b83b6d3b91ec45e395d4a6dae1ce7532
I20260812 07:00:59.678088 14983 raft_consensus.cc:2726] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 07:00:59.751178 14984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:00:59.750425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:41145)
0812 07:00:59.750913 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0812 07:00:59.750998 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":243,"threads_started":1}
I20260812 07:01:00.172598 14985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:00.171861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:38895)
0812 07:01:00.172327 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:00.172431 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":242,"threads_started":1}
I20260812 07:01:00.596580 14987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:00.595922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:60491)
0812 07:01:00.596326 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:00.596430 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":215,"threads_started":1}
I20260812 07:01:00.752795 14989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:00.752034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:42299)
0812 07:01:00.752522 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:00.752626 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":264,"threads_started":1}
I20260812 07:01:01.174242 14992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:01.173471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:35735)
0812 07:01:01.173986 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:01.174065 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":270,"threads_started":1}
I20260812 07:01:01.598148 14993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:01.597399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:37319)
0812 07:01:01.597846 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:01.597971 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":235,"threads_started":1}
I20260812 07:01:01.756542 14996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:01.754461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:46377)
0812 07:01:01.755893 (+ 1432us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:01.756277 (+ 384us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":988,"thread_start_us":533,"threads_started":1}
I20260812 07:01:02.176051 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:02.175161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:49969)
0812 07:01:02.175767 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:02.175864 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":254,"threads_started":1}
I20260812 07:01:02.600106 15001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:02.599195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:35017)
0812 07:01:02.599771 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:02.599878 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":272,"threads_started":1}
I20260812 07:01:02.650549 15002 raft_consensus.cc:482] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:01:02.650818 15002 raft_consensus.cc:504] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:01:02.651597 15002 leader_election.cc:288] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525), b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109)
W20260812 07:01:02.652693 14268 leader_election.cc:341] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109): Not found: Tablet not found: d516b4f7a2374293b242a28a5c6a9a1f
W20260812 07:01:02.652904 14266 leader_election.cc:341] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525): Not found: Tablet not found: d516b4f7a2374293b242a28a5c6a9a1f
I20260812 07:01:02.653012 14266 leader_election.cc:302] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc6467ed9574db9989e6a75b2647981; no voters: 4aaf3457ba9d4bbba3cf4561ac9eea9a, b83b6d3b91ec45e395d4a6dae1ce7532
I20260812 07:01:02.653292 15002 raft_consensus.cc:2726] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 07:01:02.758450 15006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:02.757572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:36355)
0812 07:01:02.758100 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:02.758234 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":255,"threads_started":1}
I20260812 07:01:03.177626 15010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:03.176898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:43007)
0812 07:01:03.177332 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:03.177431 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":229,"threads_started":1}
I20260812 07:01:03.601649 15011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:03.600963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:56469)
0812 07:01:03.601393 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:03.601477 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":216,"threads_started":1}
I20260812 07:01:03.759964 15014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:03.759284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:41509)
0812 07:01:03.759696 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:03.759778 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":209,"threads_started":1}
I20260812 07:01:04.179270 15016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:04.178498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:41531)
0812 07:01:04.179010 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:04.179111 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":262,"threads_started":1}
I20260812 07:01:04.603191 15018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:04.602480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:58119)
0812 07:01:04.602960 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:04.603039 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":222,"threads_started":1}
I20260812 07:01:04.761529 15022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:04.760847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:39609)
0812 07:01:04.761268 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:04.761350 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":221,"threads_started":1}
I20260812 07:01:05.180903 15024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:05.180153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:58467)
0812 07:01:05.180642 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:05.180723 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":279,"threads_started":1}
I20260812 07:01:05.604624 15025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:05.603974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:37533)
0812 07:01:05.604366 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:05.604454 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":208,"threads_started":1}
I20260812 07:01:05.763135 15026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:05.762420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:45949)
0812 07:01:05.762866 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:05.762959 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":224,"threads_started":1}
I20260812 07:01:06.182534 15028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:06.181755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:52493)
0812 07:01:06.182258 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:06.182347 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":279,"threads_started":1}
I20260812 07:01:06.606132 15031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:06.605409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:33185)
0812 07:01:06.605856 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:06.605974 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":226,"threads_started":1}
I20260812 07:01:06.764675 15032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:06.763964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:48995)
0812 07:01:06.764402 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:06.764482 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":224,"threads_started":1}
I20260812 07:01:07.184039 15033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:07.183345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:38093)
0812 07:01:07.183786 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:07.183865 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":230,"threads_started":1}
I20260812 07:01:07.607605 15034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:07.606908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:54907)
0812 07:01:07.607346 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:07.607433 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":231,"threads_started":1}
I20260812 07:01:07.766265 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:07.765511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:58851)
0812 07:01:07.765984 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:07.766080 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":219,"threads_started":1}
I20260812 07:01:08.185577 15036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:08.184837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:35871)
0812 07:01:08.185299 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:08.185411 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":242,"threads_started":1}
I20260812 07:01:08.609138 15037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:08.608396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:41171)
0812 07:01:08.608877 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:08.608977 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":247,"threads_started":1}
I20260812 07:01:08.730444 15039 raft_consensus.cc:482] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:01:08.730625 15039 raft_consensus.cc:504] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aaf3457ba9d4bbba3cf4561ac9eea9a" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39525 } } peers { permanent_uuid: "b83b6d3b91ec45e395d4a6dae1ce7532" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 34109 } } peers { permanent_uuid: "6cc6467ed9574db9989e6a75b2647981" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 35997 } }
I20260812 07:01:08.731384 15039 leader_election.cc:288] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525), b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109)
W20260812 07:01:08.732275 14266 leader_election.cc:341] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4aaf3457ba9d4bbba3cf4561ac9eea9a (127.18.70.130:39525): Not found: Tablet not found: d516b4f7a2374293b242a28a5c6a9a1f
W20260812 07:01:08.732458 14268 leader_election.cc:341] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b83b6d3b91ec45e395d4a6dae1ce7532 (127.18.70.131:34109): Not found: Tablet not found: d516b4f7a2374293b242a28a5c6a9a1f
I20260812 07:01:08.732578 14268 leader_election.cc:302] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc6467ed9574db9989e6a75b2647981; no voters: 4aaf3457ba9d4bbba3cf4561ac9eea9a, b83b6d3b91ec45e395d4a6dae1ce7532
I20260812 07:01:08.732815 15039 raft_consensus.cc:2726] T d516b4f7a2374293b242a28a5c6a9a1f P 6cc6467ed9574db9989e6a75b2647981 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 07:01:08.767840 15040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:08.767032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:58157)
0812 07:01:08.767516 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:08.767619 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":252,"threads_started":1}
I20260812 07:01:09.187060 15041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:09.186342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:47687)
0812 07:01:09.186763 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:09.186865 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":221,"threads_started":1}
I20260812 07:01:09.610682 15042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:09.609958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:53379)
0812 07:01:09.610392 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:09.610494 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":210,"threads_started":1}
I20260812 07:01:09.769582 15043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:09.768907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.129:40069)
0812 07:01:09.769297 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:09.769402 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":201,"threads_started":1}
I20260812 07:01:10.188735 15044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:10.188032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.130:46439)
0812 07:01:10.188476 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:10.188565 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":218,"threads_started":1}
I20260812 07:01:10.594797 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 14175
I20260812 07:01:10.610498 15045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:10.595961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35878 (local address 127.18.70.129:35997)
0812 07:01:10.597054 (+ 1093us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:10.597064 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:10.597100 (+ 36us) server_negotiation.cc:407] Connection header received
0812 07:01:10.597196 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:10.597206 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:10.597564 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:10.597986 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:10.599783 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:10.600812 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:10.602061 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:10.602626 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:10.602721 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:10.605125 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:10.605135 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:10.605149 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:10.605191 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:10.608055 (+ 2864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:10.608673 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:10.608679 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:10.608681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:10.608810 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:10.609098 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:10.609101 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:10.609103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:10.609504 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:10.609773 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:10.609994 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 07:01:10.610211 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":896,"thread_start_us":721,"threads_started":1}
I20260812 07:01:10.611748 14479 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:01:10.612509 15046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:10.611655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:36193 (local address 127.18.70.131:38847)
0812 07:01:10.612171 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:10.612305 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:36193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":244,"threads_started":1}
I20260812 07:01:10.704581 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 14175
I20260812 07:01:10.732162 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 14498
I20260812 07:01:10.745291 15052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:10.732891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52712 (local address 127.18.70.130:39525)
0812 07:01:10.733491 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:10.733496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:10.733513 (+ 17us) server_negotiation.cc:407] Connection header received
0812 07:01:10.733573 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:10.733577 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:10.733637 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:10.733723 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:10.735246 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:10.736091 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:10.737419 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:10.737830 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:10.738009 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:10.740390 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:10.740396 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:10.740399 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:10.740440 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:10.743084 (+ 2644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:10.743657 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:10.743660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:10.743662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:10.743813 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:10.744093 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:10.744096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:10.744098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:10.744334 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:10.744563 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:10.744743 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 07:01:10.744934 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":342,"threads_started":1}
I20260812 07:01:10.746048 14708 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:01:10.832768 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 14498
I20260812 07:01:10.862564 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 14729
I20260812 07:01:10.875792 15054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:10.863374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52900 (local address 127.18.70.131:34109)
0812 07:01:10.863969 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:10.863974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:10.864016 (+ 42us) server_negotiation.cc:407] Connection header received
0812 07:01:10.864105 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:10.864110 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:10.864196 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:10.864288 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:10.865785 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:10.866691 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:10.867847 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:10.868262 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:10.868351 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:10.870869 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:10.870874 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:10.870877 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:10.870925 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:10.873621 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:10.874236 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:10.874240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:10.874242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:10.874386 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:10.874657 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:10.874660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:10.874662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:10.874921 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:10.875138 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:10.875324 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 07:01:10.875498 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":309,"threads_started":1}
I20260812 07:01:10.876535 14941 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:01:10.963518 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 14729
2026-08-12T07:01:10Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24609 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:01:11 dist-test-slave-tc2s krb5kdc[15063](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:01:11 dist-test-slave-tc2s krb5kdc[15063](info): set up 2 sockets
Aug 12 07:01:11 dist-test-slave-tc2s krb5kdc[15063](info): commencing operation
krb5kdc: starting...
W20260812 07:01:12.222195 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.002s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:01:12 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:01:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:01:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:01:12.471105 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:44799
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:44799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:01:12.794617 15084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:01:12.794890 15084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:01:12.795037 15084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:01:12.801985 15084 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 07:01:12.802083 15084 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 07:01:12.802147 15084 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 07:01:12.802217 15084 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:01:12.802294 15084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:01:12.802389 15084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:01:12.802448 15084 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:01:12.802525 15084 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:01:12.812043 15084 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:44799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:44799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:01:12.813160 15084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:01:12.814409 15084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:01:12.825445 15096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:12.825485 15093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:12.825518 15092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:01:12.826196 15084 server_base.cc:1034] running on GCE node
I20260812 07:01:12.826886 15084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:01:12.828081 15084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:01:12.829288 15084 hybrid_clock.cc:648] HybridClock initialized: now 1786518072829225 us; error 40 us; skew 500 ppm
I20260812 07:01:12.829574 15084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:01:12 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518072, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:01:12.832523 15084 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:01:12.833819 15084 webserver.cc:460] Webserver started at http://127.18.70.190:44173/ using document root <none> and password file <none>
I20260812 07:01:12.834466 15084 fs_manager.cc:359] Metadata directory not provided
I20260812 07:01:12.834555 15084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:01:12.834822 15084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:01:12.837553 15084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "f4d3f329ac824ae4a440f08b4600f099"
format_stamp: "Formatted at 2026-08-12 07:01:12 on dist-test-slave-tc2s"
server_key: "b594d073ec9464b9af36682a220f5fe9"
server_key_iv: "b0854e6b150bb54cecd34c002cce8b42"
server_key_version: "encryptionkey@0"
I20260812 07:01:12.838284 15084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "f4d3f329ac824ae4a440f08b4600f099"
format_stamp: "Formatted at 2026-08-12 07:01:12 on dist-test-slave-tc2s"
server_key: "b594d073ec9464b9af36682a220f5fe9"
server_key_iv: "b0854e6b150bb54cecd34c002cce8b42"
server_key_version: "encryptionkey@0"
I20260812 07:01:12.842891 15084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 07:01:12.845988 15109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:12.847131 15084 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 07:01:12.847276 15084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "f4d3f329ac824ae4a440f08b4600f099"
format_stamp: "Formatted at 2026-08-12 07:01:12 on dist-test-slave-tc2s"
server_key: "b594d073ec9464b9af36682a220f5fe9"
server_key_iv: "b0854e6b150bb54cecd34c002cce8b42"
server_key_version: "encryptionkey@0"
I20260812 07:01:12.847456 15084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:01:12.869868 15084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:01:12.873420 15084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:01:12.873651 15084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:01:12.890998 15084 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:44799
I20260812 07:01:12.891026 15192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:44799 every 8 connection(s)
I20260812 07:01:12.892226 15084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:01:12.895562 15194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:01:12.900249 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 15084
I20260812 07:01:12.900466 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:01:12.901149 18714 external_mini_cluster.cc:1428] Setting key 9fbefa59c6be4e93851c4200082575c3
I20260812 07:01:12.905725 15194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Bootstrap starting.
I20260812 07:01:12.909121 15194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Neither blocks nor log segments found. Creating new log.
I20260812 07:01:12.910328 15194 log.cc:824] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Log is configured to *not* fsync() on all Append() calls
I20260812 07:01:12.912969 15194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: No bootstrap required, opened a new log
Aug 12 07:01:12 dist-test-slave-tc2s krb5kdc[15063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:01:12.920696 15194 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:12.921008 15194 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:01:12.921151 15194 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4d3f329ac824ae4a440f08b4600f099, State: Initialized, Role: FOLLOWER
I20260812 07:01:12.921720 15194 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:12.921973 15194 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:01:12.922111 15194 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:01:12.922277 15194 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:01:12.923125 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:12.903017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44694 (local address 127.18.70.190:44799)
0812 07:01:12.903802 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:12.903812 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:12.903853 (+ 41us) server_negotiation.cc:407] Connection header received
0812 07:01:12.905458 (+ 1605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:12.905480 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:12.905808 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:12.906162 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:12.908052 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:12.909338 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:12.911136 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:12.911769 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:12.911978 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:12.916076 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:12.916084 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:12.916096 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:12.916131 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:12.919223 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:12.919884 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:12.919890 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:12.919896 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:12.920085 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:12.920488 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:12.920492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:12.920494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:12.920955 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:12.921267 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:12.921703 (+ 436us) server_negotiation.cc:299] Negotiation successful
0812 07:01:12.922161 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":362,"threads_started":1}
I20260812 07:01:12.924715 15194 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:12.925251 15194 leader_election.cc:302] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4d3f329ac824ae4a440f08b4600f099; no voters:
I20260812 07:01:12.926158 15194 leader_election.cc:288] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:01:12.926244 15199 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:01:12.926872 15199 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 1 LEADER]: Becoming Leader. State: Replica: f4d3f329ac824ae4a440f08b4600f099, State: Running, Role: LEADER
I20260812 07:01:12.927384 15199 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:12.927937 15194 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:01:12.930954 15201 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4d3f329ac824ae4a440f08b4600f099. Latest consensus state: current_term: 1 leader_uuid: "f4d3f329ac824ae4a440f08b4600f099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } } }
I20260812 07:01:12.931532 15201 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: This master's current role is: LEADER
I20260812 07:01:12.931385 15200 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4d3f329ac824ae4a440f08b4600f099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } } }
I20260812 07:01:12.931849 15200 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: This master's current role is: LEADER
I20260812 07:01:12.935107 15220 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:01:12.939947 15220 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:01:12.947733 15220 catalog_manager.cc:1347] Generated new cluster ID: 2c39207269da4c0e8425b520df7adae3
I20260812 07:01:12.947816 15220 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:01:12.962986 15220 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:01:12.964628 15220 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:01:12.975934 15220 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Generated new TSK 0
I20260812 07:01:12.976627 15220 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 07:01:13.043561 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:44799
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:01:13.370492 15245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:01:13.370740 15245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:01:13.370838 15245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:01:13.377640 15245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:01:13.377754 15245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:01:13.377872 15245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:01:13.386950 15245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:01:13.388032 15245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:01:13.389213 15245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:01:13.401319 15251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:13.401347 15254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:13.401376 15260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:01:13.402397 15245 server_base.cc:1034] running on GCE node
I20260812 07:01:13.402987 15245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:01:13.403892 15245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:01:13.405100 15245 hybrid_clock.cc:648] HybridClock initialized: now 1786518073405047 us; error 44 us; skew 500 ppm
I20260812 07:01:13.405398 15245 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:01:13 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518073, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:01:13.408986 15245 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 07:01:13.410490 15245 webserver.cc:460] Webserver started at http://127.18.70.129:39055/ using document root <none> and password file <none>
I20260812 07:01:13.411128 15245 fs_manager.cc:359] Metadata directory not provided
I20260812 07:01:13.411242 15245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:01:13.411563 15245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:01:13.414481 15245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "c707053729dc4385a775930f7cdf3e66"
format_stamp: "Formatted at 2026-08-12 07:01:13 on dist-test-slave-tc2s"
server_key: "a5cfe7b447a42c212f56f0908d527ac9"
server_key_iv: "317e5b2ebadd12203c6825944ec4fde0"
server_key_version: "encryptionkey@0"
I20260812 07:01:13.415187 15245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "c707053729dc4385a775930f7cdf3e66"
format_stamp: "Formatted at 2026-08-12 07:01:13 on dist-test-slave-tc2s"
server_key: "a5cfe7b447a42c212f56f0908d527ac9"
server_key_iv: "317e5b2ebadd12203c6825944ec4fde0"
server_key_version: "encryptionkey@0"
I20260812 07:01:13.419955 15245 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 07:01:13.423251 15274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:13.424410 15245 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 07:01:13.424561 15245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "c707053729dc4385a775930f7cdf3e66"
format_stamp: "Formatted at 2026-08-12 07:01:13 on dist-test-slave-tc2s"
server_key: "a5cfe7b447a42c212f56f0908d527ac9"
server_key_iv: "317e5b2ebadd12203c6825944ec4fde0"
server_key_version: "encryptionkey@0"
I20260812 07:01:13.424724 15245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:01:13.437130 15245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:01:13.441045 15245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:01:13.441286 15245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:01:13.442157 15245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:01:13.443375 15245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:01:13.443450 15245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:13.443572 15245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:01:13.443626 15245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:13.473886 15245 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:44829
I20260812 07:01:13.473980 15476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:44829 every 8 connection(s)
I20260812 07:01:13.475065 15245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:01:13.479437 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 15245
I20260812 07:01:13.479629 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 07:01:13.480268 18714 external_mini_cluster.cc:1428] Setting key 8fe5cd9e6d8e060b057cdabaa77850e3
Aug 12 07:01:13 dist-test-slave-tc2s krb5kdc[15063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518073, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:01:13.493705 15480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:13.477547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:47055 (local address 127.18.70.190:44799)
0812 07:01:13.478049 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:13.478054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:13.478935 (+ 881us) server_negotiation.cc:407] Connection header received
0812 07:01:13.480751 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:13.480757 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:13.480839 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:13.480934 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:13.482370 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:13.483078 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:13.484543 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:13.484946 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:13.485062 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:13.488225 (+ 3163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:13.488230 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:13.488233 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:13.488265 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:13.490737 (+ 2472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:13.491407 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:13.491412 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:13.491414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:13.491546 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:13.491945 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:13.491948 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:13.491950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:13.492213 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:13.492347 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:13.492988 (+ 641us) server_negotiation.cc:299] Negotiation successful
0812 07:01:13.493253 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":282,"threads_started":1}
I20260812 07:01:13.494525 15481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:13.478093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:47055)
0812 07:01:13.478776 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:13.478819 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:13.480491 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:13.481163 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:13.481170 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:13.481644 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:01:13.482209 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:13.482228 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:13.483226 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:13.483230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:13.484405 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:13.484417 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:13.485164 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:13.485171 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:13.485379 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:13.485997 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:01:13.486019 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:01:13.488022 (+ 2003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:01:13.490879 (+ 2857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:13.490888 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:13.490900 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:13.491283 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:13.491650 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:13.491655 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:13.491659 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:13.491829 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:13.492336 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:01:13.492343 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:01:13.492633 (+ 290us) client_negotiation.cc:769] Sending connection context
0812 07:01:13.492849 (+ 216us) client_negotiation.cc:240] Negotiation successful
0812 07:01:13.493297 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":266,"threads_started":1}
I20260812 07:01:13.495972 15477 heartbeater.cc:347] Connected to a master server at 127.18.70.190:44799
I20260812 07:01:13.496244 15477 heartbeater.cc:464] Registering TS with master...
I20260812 07:01:13.496920 15477 heartbeater.cc:511] Master 127.18.70.190:44799 requested a full tablet report, sending...
I20260812 07:01:13.499162 15143 ts_manager.cc:194] Registered new tserver with Master: c707053729dc4385a775930f7cdf3e66 (127.18.70.129:44829)
I20260812 07:01:13.501042 15143 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:47055
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 07:01:13.537664 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:44799
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:01:13.860962 15486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:01:13.861207 15486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:01:13.861307 15486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:01:13.868295 15486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:01:13.868392 15486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:01:13.868508 15486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:01:13.877735 15486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:01:13.878829 15486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:01:13.879998 15486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:01:13.892333 15496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:13.892305 15498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:13.893128 15502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:01:13.894004 15486 server_base.cc:1034] running on GCE node
I20260812 07:01:13.894619 15486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:01:13.895602 15486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:01:13.896838 15486 hybrid_clock.cc:648] HybridClock initialized: now 1786518073896794 us; error 35 us; skew 500 ppm
I20260812 07:01:13.897179 15486 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:01:13 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518073, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:01:13.900774 15486 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 07:01:13.902328 15486 webserver.cc:460] Webserver started at http://127.18.70.130:42153/ using document root <none> and password file <none>
I20260812 07:01:13.903132 15486 fs_manager.cc:359] Metadata directory not provided
I20260812 07:01:13.903254 15486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:01:13.903568 15486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:01:13.907243 15486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "4057f7cead5a405fab5ef9d35f697042"
format_stamp: "Formatted at 2026-08-12 07:01:13 on dist-test-slave-tc2s"
server_key: "b5e884a10f1efaa2129e1a09f9a3b6fc"
server_key_iv: "8db939aeb0a90b1c936612696599bc26"
server_key_version: "encryptionkey@0"
I20260812 07:01:13.908131 15486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "4057f7cead5a405fab5ef9d35f697042"
format_stamp: "Formatted at 2026-08-12 07:01:13 on dist-test-slave-tc2s"
server_key: "b5e884a10f1efaa2129e1a09f9a3b6fc"
server_key_iv: "8db939aeb0a90b1c936612696599bc26"
server_key_version: "encryptionkey@0"
I20260812 07:01:13.913353 15486 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260812 07:01:13.916663 15515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:13.917827 15486 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 07:01:13.918017 15486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "4057f7cead5a405fab5ef9d35f697042"
format_stamp: "Formatted at 2026-08-12 07:01:13 on dist-test-slave-tc2s"
server_key: "b5e884a10f1efaa2129e1a09f9a3b6fc"
server_key_iv: "8db939aeb0a90b1c936612696599bc26"
server_key_version: "encryptionkey@0"
I20260812 07:01:13.918184 15486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:01:13.934617 15486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:01:13.938230 15486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:01:13.938474 15486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:01:13.939407 15486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:01:13.940637 15486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:01:13.940709 15486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:13.940827 15486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:01:13.940886 15486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:13.971628 15486 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:39831
I20260812 07:01:13.971670 15706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:39831 every 8 connection(s)
I20260812 07:01:13.972754 15486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:01:13.978469 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 15486
I20260812 07:01:13.978637 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 07:01:13.979064 18714 external_mini_cluster.cc:1428] Setting key 9fc2ae8b2534d08838b43023d3899cd6
Aug 12 07:01:13 dist-test-slave-tc2s krb5kdc[15063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518073, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:01:13.991068 15480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:13.975059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:53881 (local address 127.18.70.190:44799)
0812 07:01:13.975228 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:13.975233 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:13.976287 (+ 1054us) server_negotiation.cc:407] Connection header received
0812 07:01:13.978079 (+ 1792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:13.978085 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:13.978182 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:13.978269 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:13.979787 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:13.980542 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:13.982071 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:13.982487 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:13.982596 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:13.985819 (+ 3223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:13.985824 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:13.985827 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:13.985857 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:13.988215 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:13.988865 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:13.988870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:13.988874 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:13.989012 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:13.989422 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:13.989427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:13.989429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:13.989674 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:13.989809 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:13.990471 (+ 662us) server_negotiation.cc:299] Negotiation successful
0812 07:01:13.990704 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 07:01:13.991986 15712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:13.975459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:53881)
0812 07:01:13.976142 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:13.976184 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:13.977799 (+ 1615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:13.978507 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:13.978514 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:13.979053 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:01:13.979617 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:13.979635 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:13.980694 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:13.980698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:13.981934 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:13.981950 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:13.982705 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:13.982714 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:13.982938 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:13.983522 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:01:13.983549 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:01:13.985619 (+ 2070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:01:13.988343 (+ 2724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:13.988352 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:13.988366 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:13.988751 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:13.989126 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:13.989131 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:13.989135 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:13.989314 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:13.989799 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:01:13.989806 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:01:13.990141 (+ 335us) client_negotiation.cc:769] Sending connection context
0812 07:01:13.990371 (+ 230us) client_negotiation.cc:240] Negotiation successful
0812 07:01:13.990866 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":266,"threads_started":1}
I20260812 07:01:13.993268 15708 heartbeater.cc:347] Connected to a master server at 127.18.70.190:44799
I20260812 07:01:13.993535 15708 heartbeater.cc:464] Registering TS with master...
I20260812 07:01:13.994242 15708 heartbeater.cc:511] Master 127.18.70.190:44799 requested a full tablet report, sending...
I20260812 07:01:13.995589 15143 ts_manager.cc:194] Registered new tserver with Master: 4057f7cead5a405fab5ef9d35f697042 (127.18.70.130:39831)
I20260812 07:01:13.996373 15143 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:53881
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 07:01:14.035048 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:44799
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:01:14.354960 15715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:01:14.355201 15715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:01:14.355325 15715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:01:14.362264 15715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:01:14.362375 15715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:01:14.362526 15715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:01:14.371541 15715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:01:14.372632 15715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:01:14.373863 15715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:01:14.386114 15720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:14.386190 15724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:14.386250 15721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:01:14.386989 15715 server_base.cc:1034] running on GCE node
I20260812 07:01:14.387552 15715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:01:14.388371 15715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:01:14.389578 15715 hybrid_clock.cc:648] HybridClock initialized: now 1786518074389535 us; error 30 us; skew 500 ppm
I20260812 07:01:14.389860 15715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:01:14 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518074, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:01:14.392822 15715 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 07:01:14.394148 15715 webserver.cc:460] Webserver started at http://127.18.70.131:43791/ using document root <none> and password file <none>
I20260812 07:01:14.394797 15715 fs_manager.cc:359] Metadata directory not provided
I20260812 07:01:14.394899 15715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:01:14.395152 15715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:01:14.397945 15715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "d744846754024e208653c976052df17d"
format_stamp: "Formatted at 2026-08-12 07:01:14 on dist-test-slave-tc2s"
server_key: "7b10300bbc0e512555f114c270ba1fed"
server_key_iv: "13bddda4e935a979e4a296054b7332a0"
server_key_version: "encryptionkey@0"
I20260812 07:01:14.398658 15715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "d744846754024e208653c976052df17d"
format_stamp: "Formatted at 2026-08-12 07:01:14 on dist-test-slave-tc2s"
server_key: "7b10300bbc0e512555f114c270ba1fed"
server_key_iv: "13bddda4e935a979e4a296054b7332a0"
server_key_version: "encryptionkey@0"
I20260812 07:01:14.403362 15715 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260812 07:01:14.406680 15735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:14.407893 15715 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 07:01:14.408041 15715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "d744846754024e208653c976052df17d"
format_stamp: "Formatted at 2026-08-12 07:01:14 on dist-test-slave-tc2s"
server_key: "7b10300bbc0e512555f114c270ba1fed"
server_key_iv: "13bddda4e935a979e4a296054b7332a0"
server_key_version: "encryptionkey@0"
I20260812 07:01:14.408207 15715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:01:14.436080 15715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:01:14.439864 15715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:01:14.440114 15715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:01:14.441018 15715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:01:14.442283 15715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:01:14.442363 15715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:14.442484 15715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:01:14.442538 15715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:14.472358 15715 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:35737
I20260812 07:01:14.472417 15931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:35737 every 8 connection(s)
I20260812 07:01:14.473532 15715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:01:14.475732 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 15715
I20260812 07:01:14.475937 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 07:01:14.476583 18714 external_mini_cluster.cc:1428] Setting key 513a1a2196247b0f7fdb3ee85a9035c7
Aug 12 07:01:14 dist-test-slave-tc2s krb5kdc[15063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518074, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:01:14.492889 15480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.476471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:40337 (local address 127.18.70.190:44799)
0812 07:01:14.476661 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:14.476667 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:14.477963 (+ 1296us) server_negotiation.cc:407] Connection header received
0812 07:01:14.480257 (+ 2294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:14.480263 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:14.480364 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:14.480449 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:14.481821 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.482624 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.484093 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.484511 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.484619 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.487756 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:14.487761 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:14.487764 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:14.487797 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:14.490165 (+ 2368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:14.490900 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:14.490905 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:14.490909 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:14.491038 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:14.491436 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:14.491440 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:14.491442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:14.491778 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:14.491902 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:14.492475 (+ 573us) server_negotiation.cc:299] Negotiation successful
0812 07:01:14.492642 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 07:01:14.493697 15934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.476992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:40337)
0812 07:01:14.477786 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:14.477839 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:14.479986 (+ 2147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:14.480681 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:14.480688 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:14.481144 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:01:14.481659 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.481675 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.482773 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.482777 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.483955 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.483967 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.484720 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.484728 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.484936 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.485467 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:01:14.485487 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:01:14.487565 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:01:14.490289 (+ 2724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:14.490298 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:14.490311 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:14.490793 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:14.491144 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:14.491149 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:14.491153 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:14.491327 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:14.491907 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:01:14.491915 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:01:14.492179 (+ 264us) client_negotiation.cc:769] Sending connection context
0812 07:01:14.492393 (+ 214us) client_negotiation.cc:240] Negotiation successful
0812 07:01:14.492759 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":333,"threads_started":1}
I20260812 07:01:14.494825 15932 heartbeater.cc:347] Connected to a master server at 127.18.70.190:44799
I20260812 07:01:14.495091 15932 heartbeater.cc:464] Registering TS with master...
I20260812 07:01:14.495721 15932 heartbeater.cc:511] Master 127.18.70.190:44799 requested a full tablet report, sending...
I20260812 07:01:14.496981 15143 ts_manager.cc:194] Registered new tserver with Master: d744846754024e208653c976052df17d (127.18.70.131:35737)
I20260812 07:01:14.497745 15143 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:40337
I20260812 07:01:14.503723 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 07:01:14.503835 15477 heartbeater.cc:503] Master 127.18.70.190:44799 was elected leader, sending a full tablet report...
I20260812 07:01:14.519811 15480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.508431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44700 (local address 127.18.70.190:44799)
0812 07:01:14.508581 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:14.508585 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:14.509030 (+ 445us) server_negotiation.cc:407] Connection header received
0812 07:01:14.509168 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:14.509172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:14.509224 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:14.509290 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:14.510761 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.511478 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.512922 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.513304 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.513401 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.515580 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:14.515585 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:14.515588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:14.515614 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:14.517758 (+ 2144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:14.518360 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:14.518364 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:14.518366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:14.518485 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:14.518776 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:14.518779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:14.518780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:14.519055 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:14.519227 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:14.519458 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 07:01:14.519606 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 07:01:14.527141 15143 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44700:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 07:01:14.533844 15143 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 07:01:14.570186 15960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.545163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:39831 (local address 127.0.0.1:51106)
0812 07:01:14.559971 (+ 14808us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:14.560008 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:14.560155 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:14.561363 (+ 1208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:14.561372 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:14.561417 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:01:14.561924 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.561938 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.564236 (+ 2298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.564241 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.567061 (+ 2820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.567079 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.569143 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.569150 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.569373 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.569436 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 07:01:14.569543 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 07:01:14.569733 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14578,"mutex_wait_us":5,"thread_start_us":15235,"threads_started":1}
I20260812 07:01:14.570245 15961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.548056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43666 (local address 127.18.70.129:44829)
0812 07:01:14.559238 (+ 11182us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:14.559249 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:14.560717 (+ 1468us) server_negotiation.cc:407] Connection header received
0812 07:01:14.560846 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:14.560854 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:14.561074 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:14.561276 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:01:14.562403 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.564106 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.567171 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.568688 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.568805 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.569048 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:14.569676 (+ 628us) server_negotiation.cc:299] Negotiation successful
0812 07:01:14.569860 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10984,"thread_start_us":11185,"threads_started":1}
I20260812 07:01:14.571069 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.547498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.0.0.1:43666)
0812 07:01:14.560595 (+ 13097us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:14.560608 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:14.560712 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:14.561576 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:14.561581 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:14.561609 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:01:14.562123 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.562135 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.564297 (+ 2162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.564303 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.566984 (+ 2681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.567000 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.569260 (+ 2260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.569267 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.569470 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.569504 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 07:01:14.570508 (+ 1004us) client_negotiation.cc:240] Negotiation successful
0812 07:01:14.570651 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13007,"mutex_wait_us":143,"thread_start_us":12112,"threads_started":1}
I20260812 07:01:14.571874 15954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.545204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51106 (local address 127.18.70.130:39831)
0812 07:01:14.560507 (+ 15303us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:14.560515 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:14.560544 (+ 29us) server_negotiation.cc:407] Connection header received
0812 07:01:14.560643 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:14.560651 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:14.560895 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:14.562168 (+ 1273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:01:14.562398 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.564075 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.567271 (+ 3196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.568885 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.571046 (+ 2161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.571248 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:14.571344 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 07:01:14.571522 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15118,"thread_start_us":15862,"threads_started":1}
I20260812 07:01:14.575029 15362 tablet_service.cc:1467] Processing CreateTablet for tablet 260397d9f5274ff3a6f27bb237078cb8 (DEFAULT_TABLE table=test-table [id=8e90a63da72c44f58fff02f3a4d5057b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:01:14.576385 15362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 260397d9f5274ff3a6f27bb237078cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:01:14.576884 15597 tablet_service.cc:1467] Processing CreateTablet for tablet 260397d9f5274ff3a6f27bb237078cb8 (DEFAULT_TABLE table=test-table [id=8e90a63da72c44f58fff02f3a4d5057b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:01:14.578181 15597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 260397d9f5274ff3a6f27bb237078cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:01:14.579988 15960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.561005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:35737 (local address 127.0.0.1:37446)
0812 07:01:14.570397 (+ 9392us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:14.570414 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:14.570496 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:14.573518 (+ 3022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:14.573523 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:14.573548 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:01:14.573697 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.573707 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.575659 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.575664 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.577460 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.577475 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.579291 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.579297 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.579479 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.579512 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 07:01:14.579599 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 07:01:14.579729 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9300,"thread_start_us":12904,"threads_started":1}
I20260812 07:01:14.580243 15966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.561043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37446 (local address 127.18.70.131:35737)
0812 07:01:14.572940 (+ 11897us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:14.572948 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:14.572982 (+ 34us) server_negotiation.cc:407] Connection header received
0812 07:01:14.573085 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:14.573093 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:14.573300 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:14.573505 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:01:14.573919 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.575495 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.577647 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.579120 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.579265 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.579474 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:14.579672 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 07:01:14.579828 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11715,"thread_start_us":13015,"threads_started":1}
I20260812 07:01:14.583684 15816 tablet_service.cc:1467] Processing CreateTablet for tablet 260397d9f5274ff3a6f27bb237078cb8 (DEFAULT_TABLE table=test-table [id=8e90a63da72c44f58fff02f3a4d5057b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:01:14.585067 15816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 260397d9f5274ff3a6f27bb237078cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:01:14.588490 15968 tablet_bootstrap.cc:492] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: Bootstrap starting.
I20260812 07:01:14.591482 15970 tablet_bootstrap.cc:492] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: Bootstrap starting.
I20260812 07:01:14.591581 15968 tablet_bootstrap.cc:654] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: Neither blocks nor log segments found. Creating new log.
I20260812 07:01:14.592840 15968 log.cc:824] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: Log is configured to *not* fsync() on all Append() calls
I20260812 07:01:14.594710 15970 tablet_bootstrap.cc:654] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: Neither blocks nor log segments found. Creating new log.
I20260812 07:01:14.595912 15970 log.cc:824] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: Log is configured to *not* fsync() on all Append() calls
I20260812 07:01:14.596374 15968 tablet_bootstrap.cc:492] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: No bootstrap required, opened a new log
I20260812 07:01:14.597035 15968 ts_tablet_manager.cc:1397] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 07:01:14.598095 15973 tablet_bootstrap.cc:492] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: Bootstrap starting.
I20260812 07:01:14.599416 15970 tablet_bootstrap.cc:492] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: No bootstrap required, opened a new log
I20260812 07:01:14.599663 15970 ts_tablet_manager.cc:1397] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 07:01:14.600623 15973 tablet_bootstrap.cc:654] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: Neither blocks nor log segments found. Creating new log.
I20260812 07:01:14.601497 15973 log.cc:824] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: Log is configured to *not* fsync() on all Append() calls
I20260812 07:01:14.603672 15973 tablet_bootstrap.cc:492] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: No bootstrap required, opened a new log
I20260812 07:01:14.603891 15973 ts_tablet_manager.cc:1397] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260812 07:01:14.607138 15968 raft_consensus.cc:348] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } } peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } }
I20260812 07:01:14.607553 15968 raft_consensus.cc:374] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:01:14.607648 15968 raft_consensus.cc:729] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c707053729dc4385a775930f7cdf3e66, State: Initialized, Role: FOLLOWER
I20260812 07:01:14.608225 15968 consensus_queue.cc:260] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } } peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } }
I20260812 07:01:14.609539 15970 raft_consensus.cc:348] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } } peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } }
I20260812 07:01:14.610001 15970 raft_consensus.cc:374] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:01:14.610122 15970 raft_consensus.cc:729] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4057f7cead5a405fab5ef9d35f697042, State: Initialized, Role: FOLLOWER
I20260812 07:01:14.610663 15970 consensus_queue.cc:260] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } } peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } }
I20260812 07:01:14.612375 15973 raft_consensus.cc:348] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } } peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } }
I20260812 07:01:14.612701 15973 raft_consensus.cc:374] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:01:14.612803 15973 raft_consensus.cc:729] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d744846754024e208653c976052df17d, State: Initialized, Role: FOLLOWER
I20260812 07:01:14.613284 15973 consensus_queue.cc:260] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } } peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } }
I20260812 07:01:14.614327 15932 heartbeater.cc:503] Master 127.18.70.190:44799 was elected leader, sending a full tablet report...
I20260812 07:01:14.614748 15973 ts_tablet_manager.cc:1428] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: Time spent starting tablet: real 0.011s user 0.010s sys 0.001s
I20260812 07:01:14.615549 15708 heartbeater.cc:503] Master 127.18.70.190:44799 was elected leader, sending a full tablet report...
I20260812 07:01:14.616149 15970 ts_tablet_manager.cc:1428] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: Time spent starting tablet: real 0.016s user 0.013s sys 0.004s
I20260812 07:01:14.617621 15968 ts_tablet_manager.cc:1428] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: Time spent starting tablet: real 0.020s user 0.016s sys 0.000s
W20260812 07:01:14.724627 15710 tablet.cc:2369] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:01:14.725140 15933 tablet.cc:2369] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:01:14.727336 15479 tablet.cc:2369] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:01:14.741650 15979 raft_consensus.cc:482] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:01:14.741955 15979 raft_consensus.cc:504] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } } peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } }
I20260812 07:01:14.743583 15979 leader_election.cc:288] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4057f7cead5a405fab5ef9d35f697042 (127.18.70.130:39831), c707053729dc4385a775930f7cdf3e66 (127.18.70.129:44829)
I20260812 07:01:14.749009 15961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.744015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:51041 (local address 127.18.70.129:44829)
0812 07:01:14.744208 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:14.744214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:14.744236 (+ 22us) server_negotiation.cc:407] Connection header received
0812 07:01:14.744438 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:14.744444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:14.744527 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:14.744627 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:01:14.745021 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.745757 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.747400 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.748164 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.748309 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.748394 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:14.748649 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 07:01:14.748774 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 07:01:14.749017 15934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.743807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.18.70.131:51041)
0812 07:01:14.744118 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:14.744138 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:14.744263 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:14.744671 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:14.744674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:14.744702 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:01:14.744859 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.744866 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.745930 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.745934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.747228 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.747240 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.748314 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.748320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.748494 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.748519 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 07:01:14.748599 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 07:01:14.748721 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":20}
I20260812 07:01:14.749715 15954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.744060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:58673 (local address 127.18.70.130:39831)
0812 07:01:14.744253 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:14.744258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:14.744793 (+ 535us) server_negotiation.cc:407] Connection header received
0812 07:01:14.744986 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:14.744990 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:14.745059 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:14.745134 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:01:14.745641 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.746348 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.748039 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.748775 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.748916 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.748988 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:14.749389 (+ 401us) server_negotiation.cc:299] Negotiation successful
0812 07:01:14.749524 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 07:01:14.749748 15980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.743893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:39831 (local address 127.18.70.131:58673)
0812 07:01:14.744703 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:14.744721 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:14.744849 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:14.745173 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:14.745177 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:14.745201 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:01:14.745498 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.745507 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.746511 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.746514 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.747883 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:14.747895 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.748987 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.748993 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:14.749172 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.749204 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 07:01:14.749327 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 07:01:14.749424 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":19,"thread_start_us":503,"threads_started":1}
I20260812 07:01:14.750125 15410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260397d9f5274ff3a6f27bb237078cb8" candidate_uuid: "d744846754024e208653c976052df17d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c707053729dc4385a775930f7cdf3e66" is_pre_election: true
I20260812 07:01:14.750651 15410 raft_consensus.cc:2454] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d744846754024e208653c976052df17d in term 0.
I20260812 07:01:14.750746 15627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260397d9f5274ff3a6f27bb237078cb8" candidate_uuid: "d744846754024e208653c976052df17d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4057f7cead5a405fab5ef9d35f697042" is_pre_election: true
I20260812 07:01:14.751281 15741 leader_election.cc:302] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c707053729dc4385a775930f7cdf3e66, d744846754024e208653c976052df17d; no voters:
I20260812 07:01:14.751278 15627 raft_consensus.cc:2454] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d744846754024e208653c976052df17d in term 0.
I20260812 07:01:14.751619 15979 raft_consensus.cc:2781] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:01:14.751750 15979 raft_consensus.cc:482] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:01:14.751854 15979 raft_consensus.cc:3037] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:01:14.754070 15979 raft_consensus.cc:504] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } } peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } }
I20260812 07:01:14.754642 15979 leader_election.cc:288] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [CANDIDATE]: Term 1 election: Requested vote from peers 4057f7cead5a405fab5ef9d35f697042 (127.18.70.130:39831), c707053729dc4385a775930f7cdf3e66 (127.18.70.129:44829)
I20260812 07:01:14.755025 15627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260397d9f5274ff3a6f27bb237078cb8" candidate_uuid: "d744846754024e208653c976052df17d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4057f7cead5a405fab5ef9d35f697042"
I20260812 07:01:14.755106 15410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "260397d9f5274ff3a6f27bb237078cb8" candidate_uuid: "d744846754024e208653c976052df17d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c707053729dc4385a775930f7cdf3e66"
I20260812 07:01:14.755177 15627 raft_consensus.cc:3037] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:01:14.755306 15410 raft_consensus.cc:3037] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:01:14.757266 15627 raft_consensus.cc:2454] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d744846754024e208653c976052df17d in term 1.
I20260812 07:01:14.757436 15410 raft_consensus.cc:2454] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d744846754024e208653c976052df17d in term 1.
I20260812 07:01:14.757639 15736 leader_election.cc:302] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4057f7cead5a405fab5ef9d35f697042, d744846754024e208653c976052df17d; no voters:
I20260812 07:01:14.757937 15979 raft_consensus.cc:2781] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:01:14.758338 15979 raft_consensus.cc:686] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 1 LEADER]: Becoming Leader. State: Replica: d744846754024e208653c976052df17d, State: Running, Role: LEADER
I20260812 07:01:14.758826 15979 consensus_queue.cc:237] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } } peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } }
I20260812 07:01:14.763373 15143 catalog_manager.cc:5495] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d reported cstate change: term changed from 0 to 1, leader changed from <none> to d744846754024e208653c976052df17d (127.18.70.131). New cstate: current_term: 1 leader_uuid: "d744846754024e208653c976052df17d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } health_report { overall_health: HEALTHY } } }
I20260812 07:01:14.791013 15966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.785995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37450 (local address 127.18.70.131:35737)
0812 07:01:14.786150 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:14.786155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:14.786309 (+ 154us) server_negotiation.cc:407] Connection header received
0812 07:01:14.786485 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:14.786489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:14.786569 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:14.786684 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:01:14.786980 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.787669 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.789128 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.789493 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.789576 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.790094 (+ 518us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:01:14.790550 (+ 456us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:01:14.790652 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:14.790755 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 07:01:14.790817 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 07:01:14.798588 15627 raft_consensus.cc:1261] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042 [term 1 FOLLOWER]: Refusing update from remote peer d744846754024e208653c976052df17d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:01:14.798620 15410 raft_consensus.cc:1261] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66 [term 1 FOLLOWER]: Refusing update from remote peer d744846754024e208653c976052df17d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:01:14.799497 15982 consensus_queue.cc:1035] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:01:14.799819 15979 consensus_queue.cc:1035] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:01:14.808430 15985 mvcc.cc:205] Tried to move back new op lower bound from 7317578034365624320 to 7317578034216112128. Current Snapshot: MvccSnapshot[applied={T|T < 7317578034365624320}]
I20260812 07:01:14.809690 15986 mvcc.cc:205] Tried to move back new op lower bound from 7317578034365624320 to 7317578034216112128. Current Snapshot: MvccSnapshot[applied={T|T < 7317578034365624320}]
I20260812 07:01:14.824123 15143 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:01:14.824343 15143 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:01:14.827638 15143 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Sending DeleteTablet for 3 replicas of tablet 260397d9f5274ff3a6f27bb237078cb8
I20260812 07:01:14.828809 15816 tablet_service.cc:1514] Processing DeleteTablet for tablet 260397d9f5274ff3a6f27bb237078cb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:01:14 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:37446
I20260812 07:01:14.828781 15597 tablet_service.cc:1514] Processing DeleteTablet for tablet 260397d9f5274ff3a6f27bb237078cb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:01:14 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:51106
I20260812 07:01:14.828784 15362 tablet_service.cc:1514] Processing DeleteTablet for tablet 260397d9f5274ff3a6f27bb237078cb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:01:14 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:43666
I20260812 07:01:14.829999 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 15245
I20260812 07:01:14.838402 16003 tablet_replica.cc:330] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: stopping tablet replica
I20260812 07:01:14.839165 16003 raft_consensus.cc:2229] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:01:14.839565 16000 tablet_replica.cc:330] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: stopping tablet replica
I20260812 07:01:14.840065 16000 raft_consensus.cc:2229] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:01:14.840205 16003 raft_consensus.cc:2258] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:01:14.840595 16000 raft_consensus.cc:2258] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:01:14.841380 15999 tablet_replica.cc:330] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: stopping tablet replica
I20260812 07:01:14.841789 15999 raft_consensus.cc:2229] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 1 LEADER]: Raft consensus shutting down.
I20260812 07:01:14.842494 15999 raft_consensus.cc:2258] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:01:14.843081 16000 ts_tablet_manager.cc:1905] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:01:14.844339 15999 ts_tablet_manager.cc:1905] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:01:14.847596 16003 ts_tablet_manager.cc:1905] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:01:14.851532 16000 ts_tablet_manager.cc:1918] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:01:14.851601 15999 ts_tablet_manager.cc:1918] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:01:14.851817 15999 log.cc:1196] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/260397d9f5274ff3a6f27bb237078cb8
I20260812 07:01:14.852456 15999 ts_tablet_manager.cc:1939] T 260397d9f5274ff3a6f27bb237078cb8 P d744846754024e208653c976052df17d: Deleting consensus metadata
I20260812 07:01:14.854099 15110 catalog_manager.cc:4841] TS d744846754024e208653c976052df17d (127.18.70.131:35737): tablet 260397d9f5274ff3a6f27bb237078cb8 (table test-table [id=8e90a63da72c44f58fff02f3a4d5057b]) successfully deleted
Aug 12 07:01:14 dist-test-slave-tc2s krb5kdc[15063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 07:01:14.857609 16003 ts_tablet_manager.cc:1918] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:01:14.857785 16003 log.cc:1196] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/260397d9f5274ff3a6f27bb237078cb8
I20260812 07:01:14.858239 16003 ts_tablet_manager.cc:1939] T 260397d9f5274ff3a6f27bb237078cb8 P c707053729dc4385a775930f7cdf3e66: Deleting consensus metadata
I20260812 07:01:14.859656 16000 log.cc:1196] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/260397d9f5274ff3a6f27bb237078cb8
I20260812 07:01:14.859755 15118 catalog_manager.cc:4841] TS c707053729dc4385a775930f7cdf3e66 (127.18.70.129:44829): tablet 260397d9f5274ff3a6f27bb237078cb8 (table test-table [id=8e90a63da72c44f58fff02f3a4d5057b]) successfully deleted
I20260812 07:01:14.860149 16000 ts_tablet_manager.cc:1939] T 260397d9f5274ff3a6f27bb237078cb8 P 4057f7cead5a405fab5ef9d35f697042: Deleting consensus metadata
I20260812 07:01:14.861541 15110 catalog_manager.cc:4841] TS 4057f7cead5a405fab5ef9d35f697042 (127.18.70.130:39831): tablet 260397d9f5274ff3a6f27bb237078cb8 (table test-table [id=8e90a63da72c44f58fff02f3a4d5057b]) successfully deleted
I20260812 07:01:14.863813 15961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.831167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43678 (local address 127.18.70.129:44829)
0812 07:01:14.831335 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:14.831342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:14.844248 (+ 12906us) server_negotiation.cc:407] Connection header received
0812 07:01:14.844689 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:14.844695 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:14.844778 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:14.844852 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:14.846861 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.848004 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.850050 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.850735 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.850835 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.856653 (+ 5818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:14.856667 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:14.856689 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:14.856733 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:14.860704 (+ 3971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:14.861589 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:14.861598 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:14.861602 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:14.861766 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:14.862182 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:14.862188 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:14.862191 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:14.862661 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:14.862973 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:14.863201 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 07:01:14.863422 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 07:01:14.864517 15471 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:01:14.951774 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 15245
I20260812 07:01:14.975463 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 15486
Aug 12 07:01:14 dist-test-slave-tc2s krb5kdc[15063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 07:01:14.995879 15954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:14.976568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51114 (local address 127.18.70.130:39831)
0812 07:01:14.976731 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:14.976736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:14.976751 (+ 15us) server_negotiation.cc:407] Connection header received
0812 07:01:14.976799 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:14.976802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:14.976868 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:14.976960 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:14.978605 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.979783 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.982130 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:14.982764 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:14.982874 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:14.988618 (+ 5744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:14.988631 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:14.988649 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:14.988685 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:14.992438 (+ 3753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:14.993226 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:14.993234 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:14.993238 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:14.993373 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:14.993793 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:14.993799 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:14.993803 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:14.994405 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:14.994658 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:14.995281 (+ 623us) server_negotiation.cc:299] Negotiation successful
0812 07:01:14.995520 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 07:01:14.997325 15696 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:01:15.085644 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 15486
I20260812 07:01:15.116154 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 15715
Aug 12 07:01:15 dist-test-slave-tc2s krb5kdc[15063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 07:01:15.132774 15966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:15.116877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37458 (local address 127.18.70.131:35737)
0812 07:01:15.117079 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:15.117085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:15.117112 (+ 27us) server_negotiation.cc:407] Connection header received
0812 07:01:15.117254 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:15.117260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:15.117364 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:15.117497 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:15.118844 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:15.120044 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:15.121318 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:15.122055 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:15.122194 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:15.126783 (+ 4589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:15.126797 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:15.126813 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:15.126851 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:15.129946 (+ 3095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:15.130741 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:15.130748 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:15.130750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:15.130922 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:15.131349 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:15.131352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:15.131354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:15.131721 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:15.131971 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:15.132306 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 07:01:15.132470 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 07:01:15.133486 15925 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:01:15.254681 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 15715
I20260812 07:01:15.284134 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 15084
I20260812 07:01:15.285270 15188 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:01:15.392277 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 15084
I20260812 07:01:35.422574 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:44799
--webserver_interface=127.18.70.190
--webserver_port=44173
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:44799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:01:35.759388 16011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:01:35.759680 16011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:01:35.759859 16011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:01:35.766785 16011 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 07:01:35.766865 16011 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 07:01:35.766909 16011 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 07:01:35.766959 16011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:01:35.767011 16011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:01:35.767078 16011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:01:35.767122 16011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:01:35.767175 16011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:01:35.776546 16011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:44799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:44799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=44173
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:01:35.777637 16011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:01:35.778901 16011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:01:35.801733 16022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:35.801646 16023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:35.801695 16026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:01:35.802248 16011 server_base.cc:1034] running on GCE node
I20260812 07:01:35.803035 16011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:01:35.804433 16011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:01:35.805670 16011 hybrid_clock.cc:648] HybridClock initialized: now 1786518095805585 us; error 43 us; skew 500 ppm
I20260812 07:01:35.806097 16011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:01:35 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518095, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:01:35.813205 16011 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:01:35.814796 16011 webserver.cc:460] Webserver started at http://127.18.70.190:44173/ using document root <none> and password file <none>
I20260812 07:01:35.815548 16011 fs_manager.cc:359] Metadata directory not provided
I20260812 07:01:35.815670 16011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:01:35.821381 16011 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 07:01:35.824363 16038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:35.825670 16011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 07:01:35.825835 16011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "f4d3f329ac824ae4a440f08b4600f099"
format_stamp: "Formatted at 2026-08-12 07:01:12 on dist-test-slave-tc2s"
server_key: "b594d073ec9464b9af36682a220f5fe9"
server_key_iv: "b0854e6b150bb54cecd34c002cce8b42"
server_key_version: "encryptionkey@0"
I20260812 07:01:35.826871 16011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:01:35.845255 16011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:01:35.848964 16011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:01:35.849226 16011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:01:35.866932 16011 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:44799
I20260812 07:01:35.866968 16125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:44799 every 8 connection(s)
I20260812 07:01:35.868299 16011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:01:35.868907 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 16011
I20260812 07:01:35.869865 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:44829
--local_ip_for_outbound_sockets=127.18.70.129
--tserver_master_addrs=127.18.70.190:44799
--webserver_port=39055
--webserver_interface=127.18.70.129
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:01:35.875289 16126 sys_catalog.cc:263] Verifying existing consensus state
I20260812 07:01:35.878518 16126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Bootstrap starting.
I20260812 07:01:35.904246 16126 log.cc:824] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Log is configured to *not* fsync() on all Append() calls
I20260812 07:01:35.916571 16126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 07:01:35.917104 16126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Bootstrap complete.
I20260812 07:01:35.925881 16126 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:35.926731 16126 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4d3f329ac824ae4a440f08b4600f099, State: Initialized, Role: FOLLOWER
I20260812 07:01:35.927337 16126 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:35.927577 16126 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:01:35.927690 16126 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:01:35.927850 16126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 1 FOLLOWER]: Advancing to term 2
I20260812 07:01:35.931803 16126 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:35.932289 16126 leader_election.cc:302] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4d3f329ac824ae4a440f08b4600f099; no voters:
I20260812 07:01:35.932858 16126 leader_election.cc:288] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 07:01:35.933010 16132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 07:01:35.934150 16132 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 2 LEADER]: Becoming Leader. State: Replica: f4d3f329ac824ae4a440f08b4600f099, State: Running, Role: LEADER
I20260812 07:01:35.934793 16132 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:35.935197 16126 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:01:35.937256 16143 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4d3f329ac824ae4a440f08b4600f099. Latest consensus state: current_term: 2 leader_uuid: "f4d3f329ac824ae4a440f08b4600f099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } } }
I20260812 07:01:35.937628 16143 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: This master's current role is: LEADER
I20260812 07:01:35.938162 16134 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f4d3f329ac824ae4a440f08b4600f099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } } }
I20260812 07:01:35.938452 16134 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: This master's current role is: LEADER
I20260812 07:01:35.948426 16147 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:01:35.956595 16147 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:01:35.957979 16147 catalog_manager.cc:1259] Loaded cluster ID: 2c39207269da4c0e8425b520df7adae3
I20260812 07:01:35.958118 16147 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:01:35.962337 16147 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:01:35.963840 16147 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Loaded TSK: 0
I20260812 07:01:36.013075 16147 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Generated new TSK 1
I20260812 07:01:36.013592 16147 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 07:01:36.239886 16130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:01:36.240155 16130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:01:36.240274 16130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:01:36.247340 16130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:01:36.247444 16130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:01:36.247601 16130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:01:36.257012 16130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:44829
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=39055
--tserver_master_addrs=127.18.70.190:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:01:36.258212 16130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:01:36.259443 16130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:01:36.274271 16175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:36.274735 16174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:36.274746 16177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:01:36.275362 16130 server_base.cc:1034] running on GCE node
I20260812 07:01:36.275964 16130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:01:36.276829 16130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:01:36.278020 16130 hybrid_clock.cc:648] HybridClock initialized: now 1786518096277959 us; error 57 us; skew 500 ppm
I20260812 07:01:36.278303 16130 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:01:36 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518096, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:01:36.281450 16130 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 07:01:36.282859 16130 webserver.cc:460] Webserver started at http://127.18.70.129:39055/ using document root <none> and password file <none>
I20260812 07:01:36.283496 16130 fs_manager.cc:359] Metadata directory not provided
I20260812 07:01:36.283627 16130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:01:36.288833 16130 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260812 07:01:36.291837 16193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:36.293138 16130 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 07:01:36.293288 16130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "c707053729dc4385a775930f7cdf3e66"
format_stamp: "Formatted at 2026-08-12 07:01:13 on dist-test-slave-tc2s"
server_key: "a5cfe7b447a42c212f56f0908d527ac9"
server_key_iv: "317e5b2ebadd12203c6825944ec4fde0"
server_key_version: "encryptionkey@0"
I20260812 07:01:36.294279 16130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:01:36.308087 16130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:01:36.311864 16130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:01:36.312106 16130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:01:36.313041 16130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:01:36.314393 16130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:01:36.314498 16130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:36.314605 16130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:01:36.314695 16130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:36.346344 16130 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:44829
I20260812 07:01:36.346433 16386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:44829 every 8 connection(s)
I20260812 07:01:36.347697 16130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:01:36.351593 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 16130
I20260812 07:01:36.352227 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:39831
--local_ip_for_outbound_sockets=127.18.70.130
--tserver_master_addrs=127.18.70.190:44799
--webserver_port=42153
--webserver_interface=127.18.70.130
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 07:01:36 dist-test-slave-tc2s krb5kdc[15063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518096, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:01:36.371031 16389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:36.350250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:60081 (local address 127.18.70.190:44799)
0812 07:01:36.350836 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:36.350847 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:36.351429 (+ 582us) server_negotiation.cc:407] Connection header received
0812 07:01:36.353959 (+ 2530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:36.353979 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:36.354366 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:36.354737 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:36.356042 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:36.357762 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:36.359280 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:36.360162 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:36.360349 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:36.363651 (+ 3302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:36.363661 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:36.363678 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:36.363729 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:36.366893 (+ 3164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:36.367759 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:36.367766 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:36.367771 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:36.367940 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:36.368384 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:36.368387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:36.368389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:36.368842 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:36.368986 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:36.369773 (+ 787us) server_negotiation.cc:299] Negotiation successful
0812 07:01:36.370126 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":271,"threads_started":1}
I20260812 07:01:36.371268 16390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:36.350410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:60081)
0812 07:01:36.351229 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:36.351274 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:36.353376 (+ 2102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:36.354839 (+ 1463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:36.354846 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:36.355328 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:01:36.355844 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:36.355860 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:36.357934 (+ 2074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:36.357940 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:36.359135 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:36.359149 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:36.360357 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:36.360362 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:36.360543 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:36.361214 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:01:36.361236 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:01:36.363361 (+ 2125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:01:36.367050 (+ 3689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:36.367058 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:36.367073 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:36.367639 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:36.368046 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:36.368051 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:36.368054 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:36.368281 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:36.368978 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:01:36.368987 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:01:36.369324 (+ 337us) client_negotiation.cc:769] Sending connection context
0812 07:01:36.369590 (+ 266us) client_negotiation.cc:240] Negotiation successful
0812 07:01:36.370079 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":343,"threads_started":1}
I20260812 07:01:36.374154 16387 heartbeater.cc:347] Connected to a master server at 127.18.70.190:44799
I20260812 07:01:36.374420 16387 heartbeater.cc:464] Registering TS with master...
I20260812 07:01:36.375098 16387 heartbeater.cc:511] Master 127.18.70.190:44799 requested a full tablet report, sending...
I20260812 07:01:36.377485 16068 ts_manager.cc:194] Registered new tserver with Master: c707053729dc4385a775930f7cdf3e66 (127.18.70.129:44829)
I20260812 07:01:36.379570 16068 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:60081
W20260812 07:01:36.689452 16391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:01:36.689698 16391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:01:36.689801 16391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:01:36.696808 16391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:01:36.696956 16391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:01:36.697152 16391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:01:36.706799 16391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:39831
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=42153
--tserver_master_addrs=127.18.70.190:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:01:36.707943 16391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:01:36.709188 16391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:01:36.721539 16400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:36.721544 16398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:36.721534 16404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:01:36.722555 16391 server_base.cc:1034] running on GCE node
I20260812 07:01:36.723145 16391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:01:36.723951 16391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:01:36.725143 16391 hybrid_clock.cc:648] HybridClock initialized: now 1786518096725105 us; error 29 us; skew 500 ppm
I20260812 07:01:36.725425 16391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:01:36 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518096, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:01:36.728446 16391 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 07:01:36.729794 16391 webserver.cc:460] Webserver started at http://127.18.70.130:42153/ using document root <none> and password file <none>
I20260812 07:01:36.730495 16391 fs_manager.cc:359] Metadata directory not provided
I20260812 07:01:36.730623 16391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:01:36.735688 16391 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 07:01:36.738269 16415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:36.739447 16391 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 07:01:36.739599 16391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "4057f7cead5a405fab5ef9d35f697042"
format_stamp: "Formatted at 2026-08-12 07:01:13 on dist-test-slave-tc2s"
server_key: "b5e884a10f1efaa2129e1a09f9a3b6fc"
server_key_iv: "8db939aeb0a90b1c936612696599bc26"
server_key_version: "encryptionkey@0"
I20260812 07:01:36.740571 16391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:01:36.753471 16391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:01:36.757311 16391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:01:36.757548 16391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:01:36.758445 16391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:01:36.759665 16391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:01:36.759758 16391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:36.759856 16391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:01:36.759938 16391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:36.789723 16391 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:39831
I20260812 07:01:36.789783 16624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:39831 every 8 connection(s)
I20260812 07:01:36.791059 16391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:01:36.800776 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 16391
I20260812 07:01:36.801434 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:35737
--local_ip_for_outbound_sockets=127.18.70.131
--tserver_master_addrs=127.18.70.190:44799
--webserver_port=43791
--webserver_interface=127.18.70.131
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 07:01:36 dist-test-slave-tc2s krb5kdc[15063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518096, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:01:36.810057 16389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:36.793430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:55955 (local address 127.18.70.190:44799)
0812 07:01:36.793606 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:36.793612 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:36.794709 (+ 1097us) server_negotiation.cc:407] Connection header received
0812 07:01:36.796438 (+ 1729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:36.796443 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:36.796530 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:36.796617 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:36.798095 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:36.798821 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:36.800276 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:36.800892 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:36.801025 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:36.804303 (+ 3278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:36.804309 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:36.804313 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:36.804354 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:36.807156 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:36.807805 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:36.807809 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:36.807813 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:36.807954 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:36.808372 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:36.808376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:36.808378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:36.808693 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:36.808826 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:36.809477 (+ 651us) server_negotiation.cc:299] Negotiation successful
0812 07:01:36.809694 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 07:01:36.810786 16627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:36.793843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:55955)
0812 07:01:36.794549 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:36.794593 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:36.796204 (+ 1611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:36.796793 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:36.796800 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:36.797328 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:01:36.797866 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:36.797884 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:36.798969 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:36.798973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:36.800163 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:36.800175 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:36.801084 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:36.801089 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:36.801273 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:36.801879 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:01:36.801931 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:01:36.804077 (+ 2146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:01:36.807280 (+ 3203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:36.807286 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:36.807296 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:36.807683 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:36.808054 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:36.808058 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:36.808061 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:36.808260 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:36.808796 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:01:36.808803 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:01:36.809130 (+ 327us) client_negotiation.cc:769] Sending connection context
0812 07:01:36.809357 (+ 227us) client_negotiation.cc:240] Negotiation successful
0812 07:01:36.809759 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":265,"threads_started":1}
I20260812 07:01:36.812052 16625 heartbeater.cc:347] Connected to a master server at 127.18.70.190:44799
I20260812 07:01:36.812358 16625 heartbeater.cc:464] Registering TS with master...
I20260812 07:01:36.813179 16625 heartbeater.cc:511] Master 127.18.70.190:44799 requested a full tablet report, sending...
I20260812 07:01:36.814697 16068 ts_manager.cc:194] Registered new tserver with Master: 4057f7cead5a405fab5ef9d35f697042 (127.18.70.130:39831)
I20260812 07:01:36.815760 16068 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:55955
W20260812 07:01:37.129323 16628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:01:37.129581 16628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:01:37.129676 16628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:01:37.136750 16628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:01:37.136848 16628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:01:37.136996 16628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:01:37.146289 16628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:35737
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=43791
--tserver_master_addrs=127.18.70.190:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:01:37.147464 16628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:01:37.148653 16628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:01:37.160826 16635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:37.160928 16634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:37.160887 16637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:01:37.161870 16628 server_base.cc:1034] running on GCE node
I20260812 07:01:37.162532 16628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:01:37.163348 16628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:01:37.164543 16628 hybrid_clock.cc:648] HybridClock initialized: now 1786518097164494 us; error 43 us; skew 500 ppm
I20260812 07:01:37.164826 16628 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:01:37 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518097, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:01:37.167781 16628 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 07:01:37.169055 16628 webserver.cc:460] Webserver started at http://127.18.70.131:43791/ using document root <none> and password file <none>
I20260812 07:01:37.169683 16628 fs_manager.cc:359] Metadata directory not provided
I20260812 07:01:37.169817 16628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:01:37.174787 16628 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:01:37.177254 16646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:37.178526 16628 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 07:01:37.178675 16628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "d744846754024e208653c976052df17d"
format_stamp: "Formatted at 2026-08-12 07:01:14 on dist-test-slave-tc2s"
server_key: "7b10300bbc0e512555f114c270ba1fed"
server_key_iv: "13bddda4e935a979e4a296054b7332a0"
server_key_version: "encryptionkey@0"
I20260812 07:01:37.179615 16628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:01:37.198037 16628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:01:37.201532 16628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:01:37.201759 16628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:01:37.202682 16628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:01:37.203918 16628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:01:37.204022 16628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:37.204128 16628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:01:37.204198 16628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:37.233515 16628 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:35737
I20260812 07:01:37.233574 16842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:35737 every 8 connection(s)
I20260812 07:01:37.234903 16628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:01:37.238695 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 16628
Aug 12 07:01:37 dist-test-slave-tc2s krb5kdc[15063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518097, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:01:37.254539 16851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.239564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50984 (local address 127.18.70.190:44799)
0812 07:01:37.240568 (+ 1004us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.240572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.240586 (+ 14us) server_negotiation.cc:407] Connection header received
0812 07:01:37.240640 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.240643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.240701 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.240793 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:37.242491 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.243397 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.244910 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.245398 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.245521 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.248371 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:37.248375 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:37.248379 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:37.248407 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:37.251647 (+ 3240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:37.252414 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:37.252419 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:37.252422 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:37.252597 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:37.252986 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:37.252991 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:37.252995 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:37.253289 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:37.253488 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:37.253876 (+ 388us) server_negotiation.cc:299] Negotiation successful
0812 07:01:37.254111 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":909,"spinlock_wait_cycles":81920,"thread_start_us":805,"threads_started":1}
I20260812 07:01:37.255721 16845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.237677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:51981)
0812 07:01:37.238424 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:37.238467 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:37.240533 (+ 2066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:37.241226 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:37.241234 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:37.241709 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:01:37.242319 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.242348 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.243543 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.243547 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.244784 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.244797 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.245592 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.245601 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.245846 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.246521 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:01:37.246546 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:01:37.248686 (+ 2140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:01:37.252019 (+ 3333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:37.252025 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:37.252035 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:37.252454 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:37.252840 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:01:37.252844 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:01:37.252846 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:01:37.253056 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:01:37.253577 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:01:37.253583 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:01:37.253924 (+ 341us) client_negotiation.cc:769] Sending connection context
0812 07:01:37.254200 (+ 276us) client_negotiation.cc:240] Negotiation successful
0812 07:01:37.254651 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":309,"threads_started":1}
I20260812 07:01:37.256713 16389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.237283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:51981 (local address 127.18.70.190:44799)
0812 07:01:37.237467 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.237472 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.238584 (+ 1112us) server_negotiation.cc:407] Connection header received
0812 07:01:37.240767 (+ 2183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.240772 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.240871 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.240965 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:37.242488 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.243390 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.244916 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.245376 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.245477 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.248889 (+ 3412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:37.248895 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:37.248899 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:37.248934 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:37.251899 (+ 2965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:37.252584 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:37.252588 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:37.252590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:37.252721 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:37.253172 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:37.253176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:37.253178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:37.253457 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:37.253603 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:37.256173 (+ 2570us) server_negotiation.cc:299] Negotiation successful
0812 07:01:37.256361 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":66,"spinlock_wait_cycles":3840}
I20260812 07:01:37.257599 16843 heartbeater.cc:347] Connected to a master server at 127.18.70.190:44799
I20260812 07:01:37.257850 16843 heartbeater.cc:464] Registering TS with master...
I20260812 07:01:37.258539 16843 heartbeater.cc:511] Master 127.18.70.190:44799 requested a full tablet report, sending...
I20260812 07:01:37.259760 16068 ts_manager.cc:194] Registered new tserver with Master: d744846754024e208653c976052df17d (127.18.70.131:35737)
I20260812 07:01:37.260545 16068 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:51981
I20260812 07:01:37.268918 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 07:01:37.275234 16389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.269862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50988 (local address 127.18.70.190:44799)
0812 07:01:37.270019 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.270024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.270434 (+ 410us) server_negotiation.cc:407] Connection header received
0812 07:01:37.270634 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.270638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.270764 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.270884 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:01:37.271342 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.272052 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.273484 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.273883 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.274031 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.274487 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:01:37.274655 (+ 168us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 07:01:37.274999 (+ 344us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50988: token expired
Metrics: {"server-negotiator.queue_time_us":69}
W20260812 07:01:37.275334 16389 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50988: token expired
W20260812 07:01:37.275935 15941 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.18.70.190:44799)
I20260812 07:01:37.287873 16389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.276445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50992 (local address 127.18.70.190:44799)
0812 07:01:37.276616 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.276621 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.276634 (+ 13us) server_negotiation.cc:407] Connection header received
0812 07:01:37.276668 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.276671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.276716 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.276790 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:37.278157 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.278858 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.280142 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.280531 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.280635 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.283214 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:37.283219 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:37.283222 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:37.283249 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:37.285461 (+ 2212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:37.286124 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:37.286128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:37.286130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:37.286243 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:37.286610 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:37.286613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:37.286615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:37.286860 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:37.287096 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:37.287423 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 07:01:37.287623 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 07:01:37.290839 16068 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50992:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 07:01:37.298117 16068 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 07:01:37.320884 16866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.312019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43140 (local address 127.18.70.130:39831)
0812 07:01:37.313548 (+ 1529us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.313557 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.314127 (+ 570us) server_negotiation.cc:407] Connection header received
0812 07:01:37.314271 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.314276 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.314432 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.314586 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:01:37.315076 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.316133 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.318430 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.319331 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.319455 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.319656 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:37.320434 (+ 778us) server_negotiation.cc:299] Negotiation successful
0812 07:01:37.320600 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1366,"thread_start_us":1268,"threads_started":1}
I20260812 07:01:37.321066 16867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.312254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:39831 (local address 127.0.0.1:43140)
0812 07:01:37.314016 (+ 1762us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:37.314030 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:37.314144 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:37.314594 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:37.314598 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:37.314620 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:01:37.314931 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.314940 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.316267 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.316272 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.318283 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.318296 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.319547 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.319554 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.319737 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.319772 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 07:01:37.319882 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 07:01:37.320043 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1610,"mutex_wait_us":3,"thread_start_us":1472,"threads_started":1}
I20260812 07:01:37.321161 16859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.309381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55678 (local address 127.18.70.131:35737)
0812 07:01:37.310492 (+ 1111us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.310501 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.311560 (+ 1059us) server_negotiation.cc:407] Connection header received
0812 07:01:37.311949 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.311957 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.312180 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.312330 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:01:37.313506 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.315119 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.318356 (+ 3237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.319687 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.319787 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.320007 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:37.320648 (+ 641us) server_negotiation.cc:299] Negotiation successful
0812 07:01:37.320796 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":885,"spinlock_wait_cycles":19840,"thread_start_us":860,"threads_started":1}
I20260812 07:01:37.321339 16863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.310086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60428 (local address 127.18.70.129:44829)
0812 07:01:37.310909 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.310918 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.311560 (+ 642us) server_negotiation.cc:407] Connection header received
0812 07:01:37.311949 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.311957 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.312175 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.312330 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:01:37.313492 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.315120 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.318644 (+ 3524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.320028 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.320128 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.320313 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:37.320890 (+ 577us) server_negotiation.cc:299] Negotiation successful
0812 07:01:37.321046 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":567,"threads_started":1}
I20260812 07:01:37.322103 16858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.309658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.0.0.1:60428)
0812 07:01:37.311424 (+ 1766us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:37.311456 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:37.311708 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:37.312654 (+ 946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:37.312661 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:37.312697 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:01:37.313266 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.313279 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.315298 (+ 2019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.315303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.318477 (+ 3174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.318492 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.320540 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.320547 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.320697 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.320728 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 07:01:37.321527 (+ 799us) client_negotiation.cc:240] Negotiation successful
0812 07:01:37.321656 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1657,"mutex_wait_us":725,"spinlock_wait_cycles":29312,"thread_start_us":1361,"threads_started":1}
I20260812 07:01:37.322124 16861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.309070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:35737 (local address 127.0.0.1:55678)
0812 07:01:37.311405 (+ 2335us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:37.311456 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:37.311708 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:37.312654 (+ 946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:37.312661 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:37.312706 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:01:37.313266 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.313279 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.315300 (+ 2021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.315304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.318165 (+ 2861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.318189 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.320234 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.320240 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.320446 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.320482 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 07:01:37.321597 (+ 1115us) client_negotiation.cc:240] Negotiation successful
0812 07:01:37.321697 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2087,"mutex_wait_us":124,"spinlock_wait_cycles":3840,"thread_start_us":2058,"threads_started":1}
I20260812 07:01:37.324368 16495 tablet_service.cc:1467] Processing CreateTablet for tablet 92a55b38d5024f62907b43889f17a6dd (DEFAULT_TABLE table=test-table [id=da594b84dad444839bd71f4f53f4f7b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:01:37.324859 16728 tablet_service.cc:1467] Processing CreateTablet for tablet 92a55b38d5024f62907b43889f17a6dd (DEFAULT_TABLE table=test-table [id=da594b84dad444839bd71f4f53f4f7b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:01:37.325765 16495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92a55b38d5024f62907b43889f17a6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:01:37.326174 16728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92a55b38d5024f62907b43889f17a6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:01:37.329110 16279 tablet_service.cc:1467] Processing CreateTablet for tablet 92a55b38d5024f62907b43889f17a6dd (DEFAULT_TABLE table=test-table [id=da594b84dad444839bd71f4f53f4f7b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:01:37.330458 16279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92a55b38d5024f62907b43889f17a6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:01:37.337466 16869 tablet_bootstrap.cc:492] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: Bootstrap starting.
I20260812 07:01:37.340798 16870 tablet_bootstrap.cc:492] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: Bootstrap starting.
I20260812 07:01:37.341850 16869 tablet_bootstrap.cc:654] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: Neither blocks nor log segments found. Creating new log.
I20260812 07:01:37.343219 16869 log.cc:824] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: Log is configured to *not* fsync() on all Append() calls
I20260812 07:01:37.344295 16870 tablet_bootstrap.cc:654] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: Neither blocks nor log segments found. Creating new log.
I20260812 07:01:37.344633 16874 tablet_bootstrap.cc:492] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: Bootstrap starting.
I20260812 07:01:37.345613 16870 log.cc:824] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: Log is configured to *not* fsync() on all Append() calls
I20260812 07:01:37.346690 16869 tablet_bootstrap.cc:492] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: No bootstrap required, opened a new log
I20260812 07:01:37.346966 16869 ts_tablet_manager.cc:1397] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20260812 07:01:37.349670 16874 tablet_bootstrap.cc:654] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: Neither blocks nor log segments found. Creating new log.
I20260812 07:01:37.350940 16874 log.cc:824] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: Log is configured to *not* fsync() on all Append() calls
I20260812 07:01:37.351925 16870 tablet_bootstrap.cc:492] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: No bootstrap required, opened a new log
I20260812 07:01:37.352208 16870 ts_tablet_manager.cc:1397] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260812 07:01:37.357589 16869 raft_consensus.cc:348] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } } peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } }
I20260812 07:01:37.358057 16869 raft_consensus.cc:374] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:01:37.358155 16869 raft_consensus.cc:729] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4057f7cead5a405fab5ef9d35f697042, State: Initialized, Role: FOLLOWER
I20260812 07:01:37.358774 16869 consensus_queue.cc:260] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } } peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } }
I20260812 07:01:37.359864 16625 heartbeater.cc:503] Master 127.18.70.190:44799 was elected leader, sending a full tablet report...
I20260812 07:01:37.360522 16869 ts_tablet_manager.cc:1428] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: Time spent starting tablet: real 0.013s user 0.011s sys 0.002s
I20260812 07:01:37.362877 16874 tablet_bootstrap.cc:492] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: No bootstrap required, opened a new log
I20260812 07:01:37.363094 16874 ts_tablet_manager.cc:1397] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20260812 07:01:37.363221 16870 raft_consensus.cc:348] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } } peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } }
I20260812 07:01:37.363616 16870 raft_consensus.cc:374] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:01:37.363719 16870 raft_consensus.cc:729] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d744846754024e208653c976052df17d, State: Initialized, Role: FOLLOWER
I20260812 07:01:37.364276 16870 consensus_queue.cc:260] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } } peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } }
I20260812 07:01:37.370555 16843 heartbeater.cc:503] Master 127.18.70.190:44799 was elected leader, sending a full tablet report...
I20260812 07:01:37.370448 16874 raft_consensus.cc:348] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } } peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } }
I20260812 07:01:37.370752 16874 raft_consensus.cc:374] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:01:37.370847 16874 raft_consensus.cc:729] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c707053729dc4385a775930f7cdf3e66, State: Initialized, Role: FOLLOWER
I20260812 07:01:37.371066 16870 ts_tablet_manager.cc:1428] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: Time spent starting tablet: real 0.019s user 0.009s sys 0.007s
I20260812 07:01:37.371348 16874 consensus_queue.cc:260] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } } peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } }
I20260812 07:01:37.372272 16387 heartbeater.cc:503] Master 127.18.70.190:44799 was elected leader, sending a full tablet report...
I20260812 07:01:37.372761 16874 ts_tablet_manager.cc:1428] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
W20260812 07:01:37.486446 16844 tablet.cc:2369] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:01:37.542994 16626 tablet.cc:2369] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:01:37.599867 16388 tablet.cc:2369] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:01:37.622872 16880 raft_consensus.cc:482] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:01:37.623152 16880 raft_consensus.cc:504] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } } peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } }
I20260812 07:01:37.624739 16880 leader_election.cc:288] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d744846754024e208653c976052df17d (127.18.70.131:35737), c707053729dc4385a775930f7cdf3e66 (127.18.70.129:44829)
I20260812 07:01:37.633671 16863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.625292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:60487 (local address 127.18.70.129:44829)
0812 07:01:37.625473 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.625478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.626198 (+ 720us) server_negotiation.cc:407] Connection header received
0812 07:01:37.626397 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.626402 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.626481 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.626577 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:01:37.627377 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.628485 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.631337 (+ 2852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.632561 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.632714 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.632789 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:37.633283 (+ 494us) server_negotiation.cc:299] Negotiation successful
0812 07:01:37.633415 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 07:01:37.633682 16859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.625259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:53853 (local address 127.18.70.131:35737)
0812 07:01:37.625462 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.625469 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.626201 (+ 732us) server_negotiation.cc:407] Connection header received
0812 07:01:37.626391 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.626396 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.626481 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.626573 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:01:37.627381 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.628487 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.631338 (+ 2851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.632562 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.632719 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.632789 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:37.633284 (+ 495us) server_negotiation.cc:299] Negotiation successful
0812 07:01:37.633423 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 07:01:37.633919 16890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.625018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.18.70.130:60487)
0812 07:01:37.626074 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:37.626094 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:37.626281 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:37.626603 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:37.626609 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:37.626639 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:01:37.627227 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.627237 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.628617 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.628621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.631179 (+ 2558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.631196 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.632801 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.632808 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.633094 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.633161 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 07:01:37.633243 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 07:01:37.633402 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":160,"spinlock_wait_cycles":22400,"thread_start_us":740,"threads_started":1}
I20260812 07:01:37.634186 16884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.625099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:35737 (local address 127.18.70.130:53853)
0812 07:01:37.626079 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:37.626094 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 07:01:37.626249 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:01:37.626603 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:01:37.626609 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:01:37.626665 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:01:37.627214 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.627230 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.628611 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.628617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.631179 (+ 2562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:01:37.631196 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.632806 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.632811 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:01:37.633099 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.633149 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 07:01:37.633242 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 07:01:37.633402 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"mutex_wait_us":272,"spinlock_wait_cycles":29568,"thread_start_us":549,"threads_started":1}
I20260812 07:01:37.634902 16312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92a55b38d5024f62907b43889f17a6dd" candidate_uuid: "4057f7cead5a405fab5ef9d35f697042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c707053729dc4385a775930f7cdf3e66" is_pre_election: true
I20260812 07:01:37.635040 16769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92a55b38d5024f62907b43889f17a6dd" candidate_uuid: "4057f7cead5a405fab5ef9d35f697042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d744846754024e208653c976052df17d" is_pre_election: true
I20260812 07:01:37.635393 16312 raft_consensus.cc:2454] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4057f7cead5a405fab5ef9d35f697042 in term 0.
I20260812 07:01:37.635531 16769 raft_consensus.cc:2454] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4057f7cead5a405fab5ef9d35f697042 in term 0.
I20260812 07:01:37.636061 16423 leader_election.cc:302] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4057f7cead5a405fab5ef9d35f697042, c707053729dc4385a775930f7cdf3e66; no voters:
I20260812 07:01:37.636404 16880 raft_consensus.cc:2781] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:01:37.636528 16880 raft_consensus.cc:482] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:01:37.636622 16880 raft_consensus.cc:3037] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:01:37.641065 16880 raft_consensus.cc:504] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } } peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } }
I20260812 07:01:37.641702 16880 leader_election.cc:288] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [CANDIDATE]: Term 1 election: Requested vote from peers d744846754024e208653c976052df17d (127.18.70.131:35737), c707053729dc4385a775930f7cdf3e66 (127.18.70.129:44829)
I20260812 07:01:37.642107 16769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92a55b38d5024f62907b43889f17a6dd" candidate_uuid: "4057f7cead5a405fab5ef9d35f697042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d744846754024e208653c976052df17d"
I20260812 07:01:37.642153 16312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92a55b38d5024f62907b43889f17a6dd" candidate_uuid: "4057f7cead5a405fab5ef9d35f697042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c707053729dc4385a775930f7cdf3e66"
I20260812 07:01:37.642280 16769 raft_consensus.cc:3037] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:01:37.642339 16312 raft_consensus.cc:3037] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:01:37.644454 16769 raft_consensus.cc:2454] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4057f7cead5a405fab5ef9d35f697042 in term 1.
I20260812 07:01:37.644635 16312 raft_consensus.cc:2454] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4057f7cead5a405fab5ef9d35f697042 in term 1.
I20260812 07:01:37.644838 16416 leader_election.cc:302] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4057f7cead5a405fab5ef9d35f697042, d744846754024e208653c976052df17d; no voters:
I20260812 07:01:37.645169 16880 raft_consensus.cc:2781] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:01:37.645583 16880 raft_consensus.cc:686] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 1 LEADER]: Becoming Leader. State: Replica: 4057f7cead5a405fab5ef9d35f697042, State: Running, Role: LEADER
I20260812 07:01:37.646041 16880 consensus_queue.cc:237] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } } peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } }
I20260812 07:01:37.650561 16064 catalog_manager.cc:5495] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4057f7cead5a405fab5ef9d35f697042 (127.18.70.130). New cstate: current_term: 1 leader_uuid: "4057f7cead5a405fab5ef9d35f697042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4057f7cead5a405fab5ef9d35f697042" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 39831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 } health_report { overall_health: UNKNOWN } } }
I20260812 07:01:37.683430 16866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.677495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43156 (local address 127.18.70.130:39831)
0812 07:01:37.677655 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.677660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.677676 (+ 16us) server_negotiation.cc:407] Connection header received
0812 07:01:37.677825 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.677828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.677935 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.678051 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:01:37.678362 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.679062 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.680955 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.681571 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.681698 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.682260 (+ 562us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:01:37.682851 (+ 591us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:01:37.682997 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:37.683040 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 07:01:37.683127 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 07:01:37.690968 16769 raft_consensus.cc:1261] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d [term 1 FOLLOWER]: Refusing update from remote peer 4057f7cead5a405fab5ef9d35f697042: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:01:37.690985 16312 raft_consensus.cc:1261] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66 [term 1 FOLLOWER]: Refusing update from remote peer 4057f7cead5a405fab5ef9d35f697042: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:01:37.691867 16895 consensus_queue.cc:1035] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d744846754024e208653c976052df17d" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 35737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:01:37.692224 16880 consensus_queue.cc:1035] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c707053729dc4385a775930f7cdf3e66" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:01:37.702948 16898 mvcc.cc:205] Tried to move back new op lower bound from 7317578128133201920 to 7317578127961497600. Current Snapshot: MvccSnapshot[applied={T|T < 7317578128133201920}]
I20260812 07:01:37.715785 16068 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50992:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:01:37.716089 16068 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50992:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:01:37.719604 16068 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Sending DeleteTablet for 3 replicas of tablet 92a55b38d5024f62907b43889f17a6dd
I20260812 07:01:37.720607 16728 tablet_service.cc:1514] Processing DeleteTablet for tablet 92a55b38d5024f62907b43889f17a6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:01:37 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:55678
I20260812 07:01:37.720733 16495 tablet_service.cc:1514] Processing DeleteTablet for tablet 92a55b38d5024f62907b43889f17a6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:01:37 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:43140
I20260812 07:01:37.721500 16914 tablet_replica.cc:330] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: stopping tablet replica
I20260812 07:01:37.721633 16279 tablet_service.cc:1514] Processing DeleteTablet for tablet 92a55b38d5024f62907b43889f17a6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:01:37 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:60428
I20260812 07:01:37.722057 16914 raft_consensus.cc:2229] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:01:37.722514 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 16130
I20260812 07:01:37.722679 16914 raft_consensus.cc:2258] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:01:37.731765 16914 ts_tablet_manager.cc:1905] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:01:37.740010 16916 tablet_replica.cc:330] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: stopping tablet replica
I20260812 07:01:37.740448 16916 raft_consensus.cc:2229] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:01:37.740962 16916 raft_consensus.cc:2258] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:01:37.742128 16914 ts_tablet_manager.cc:1918] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:01:37.742293 16914 log.cc:1196] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/92a55b38d5024f62907b43889f17a6dd
I20260812 07:01:37.742839 16914 ts_tablet_manager.cc:1939] T 92a55b38d5024f62907b43889f17a6dd P d744846754024e208653c976052df17d: Deleting consensus metadata
I20260812 07:01:37.743317 16916 ts_tablet_manager.cc:1905] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:01:37.743407 16915 tablet_replica.cc:330] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: stopping tablet replica
I20260812 07:01:37.744103 16863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.723298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60432 (local address 127.18.70.129:44829)
0812 07:01:37.723466 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.723472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.723493 (+ 21us) server_negotiation.cc:407] Connection header received
0812 07:01:37.723669 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.723676 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.723755 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.723860 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:37.725870 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.727192 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.729229 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.729927 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.730046 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.734053 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:37.734069 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:37.734088 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:37.734134 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:37.738082 (+ 3948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:37.739044 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:37.739054 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:37.739059 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:37.739254 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:37.739757 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:37.739763 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:37.739771 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:37.740448 (+ 677us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:37.743307 (+ 2859us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:37.743484 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 07:01:37.743752 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 07:01:37.745043 16915 raft_consensus.cc:2229] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 1 LEADER]: Raft consensus shutting down.
I20260812 07:01:37.745404 16382 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:01:37.745616 16040 catalog_manager.cc:4841] TS d744846754024e208653c976052df17d (127.18.70.131:35737): tablet 92a55b38d5024f62907b43889f17a6dd (table test-table [id=da594b84dad444839bd71f4f53f4f7b4]) successfully deleted
I20260812 07:01:37.745791 16915 raft_consensus.cc:2258] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:01:37.747875 16915 ts_tablet_manager.cc:1905] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:01:37.753299 16915 ts_tablet_manager.cc:1918] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:01:37.753453 16915 log.cc:1196] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/92a55b38d5024f62907b43889f17a6dd
I20260812 07:01:37.753885 16915 ts_tablet_manager.cc:1939] T 92a55b38d5024f62907b43889f17a6dd P 4057f7cead5a405fab5ef9d35f697042: Deleting consensus metadata
I20260812 07:01:37.755299 16040 catalog_manager.cc:4841] TS 4057f7cead5a405fab5ef9d35f697042 (127.18.70.130:39831): tablet 92a55b38d5024f62907b43889f17a6dd (table test-table [id=da594b84dad444839bd71f4f53f4f7b4]) successfully deleted
I20260812 07:01:37.907135 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 16130
I20260812 07:01:37.932614 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 16391
W20260812 07:01:37.932580 16046 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.70.129:44829 (error 108)
I20260812 07:01:37.935099 16924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.934263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.0.0.1:60446)
0812 07:01:37.934718 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:37.934877 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":214,"threads_started":1}
W20260812 07:01:37.935422 16046 catalog_manager.cc:4584] TS c707053729dc4385a775930f7cdf3e66 (127.18.70.129:44829): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 92a55b38d5024f62907b43889f17a6dd: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44829: connect: Connection refused (error 111)
I20260812 07:01:37.950733 16866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.933688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43158 (local address 127.18.70.130:39831)
0812 07:01:37.933843 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:37.933847 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:37.933865 (+ 18us) server_negotiation.cc:407] Connection header received
0812 07:01:37.934056 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:37.934060 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:37.934125 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:37.934219 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:37.935998 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.936873 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.938255 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:37.938680 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:37.938789 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:37.945043 (+ 6254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:37.945059 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:37.945077 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:37.945123 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:37.948000 (+ 2877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:37.948649 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:37.948657 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:37.948659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:37.948801 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:37.949156 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:37.949159 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:37.949162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:37.949545 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:37.949922 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:37.950174 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 07:01:37.950388 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 07:01:37.951378 16612 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:01:37.988879 16924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.988439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.0.0.1:60456)
0812 07:01:37.988625 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:37.988712 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 07:01:37.989854 16924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:37.989514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.0.0.1:60468)
0812 07:01:37.989657 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:37.989725 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 07:01:38.050480 16924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:38.049984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.0.0.1:60478)
0812 07:01:38.050194 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:38.050305 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 07:01:38.051465 16924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:38.051105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.0.0.1:60482)
0812 07:01:38.051254 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:38.051327 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 07:01:38.062353 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 16391
I20260812 07:01:38.088219 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 16628
I20260812 07:01:38.100818 16859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:38.088922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55682 (local address 127.18.70.131:35737)
0812 07:01:38.089112 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 07:01:38.089117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:01:38.089135 (+ 18us) server_negotiation.cc:407] Connection header received
0812 07:01:38.089234 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:01:38.089238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:01:38.089300 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:01:38.089379 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:01:38.090795 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:38.091526 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:38.092799 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:01:38.093168 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:01:38.093257 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:01:38.095835 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:01:38.095851 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:01:38.095868 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:01:38.095907 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:01:38.098476 (+ 2569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:38.099140 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:38.099146 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:38.099148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:38.099280 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:01:38.099552 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:01:38.099555 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:01:38.099556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:01:38.099901 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:01:38.100117 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 07:01:38.100329 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 07:01:38.100505 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 07:01:38.101460 16836 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:01:38.131845 16924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:38.131326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.0.0.1:60492)
0812 07:01:38.131554 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:38.131662 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 07:01:38.132902 16924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:38.132457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.0.0.1:60506)
0812 07:01:38.132653 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:38.132739 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260812 07:01:38.189255 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 16628
I20260812 07:01:38.213799 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 16011
I20260812 07:01:38.214905 16119 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:01:38.328444 16924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:38.327558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44829 (local address 127.0.0.1:60508)
0812 07:01:38.328010 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:38.328155 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 07:01:38.328593 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 16011
I20260812 07:01:58.358074 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:44799
--webserver_interface=127.18.70.190
--webserver_port=44173
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:44799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:01:58.706681 16933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:01:58.706952 16933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:01:58.707082 16933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:01:58.714140 16933 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 07:01:58.714223 16933 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 07:01:58.714286 16933 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 07:01:58.714365 16933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:01:58.714444 16933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:01:58.714538 16933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:01:58.714602 16933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:01:58.714677 16933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:01:58.724123 16933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:44799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:44799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=44173
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:01:58.725273 16933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:01:58.726557 16933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:01:58.737600 16941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:58.737671 16942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:58.737644 16944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:01:58.738665 16933 server_base.cc:1034] running on GCE node
I20260812 07:01:58.739398 16933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:01:58.740696 16933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:01:58.741986 16933 hybrid_clock.cc:648] HybridClock initialized: now 1786518118741874 us; error 35 us; skew 500 ppm
I20260812 07:01:58.742388 16933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:01:58 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518118, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:01:58.746615 16933 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:01:58.748565 16933 webserver.cc:460] Webserver started at http://127.18.70.190:44173/ using document root <none> and password file <none>
I20260812 07:01:58.749516 16933 fs_manager.cc:359] Metadata directory not provided
I20260812 07:01:58.749696 16933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:01:58.755828 16933 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 07:01:58.758708 16955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:58.760077 16933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:01:58.760241 16933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "f4d3f329ac824ae4a440f08b4600f099"
format_stamp: "Formatted at 2026-08-12 07:01:12 on dist-test-slave-tc2s"
server_key: "b594d073ec9464b9af36682a220f5fe9"
server_key_iv: "b0854e6b150bb54cecd34c002cce8b42"
server_key_version: "encryptionkey@0"
I20260812 07:01:58.761189 16933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:01:58.788398 16933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:01:58.792716 16933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:01:58.792991 16933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:01:58.811167 16933 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:44799
I20260812 07:01:58.811204 17052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:44799 every 8 connection(s)
I20260812 07:01:58.812572 16933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:01:58.816529 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 16933
I20260812 07:01:58.817600 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:44829
--local_ip_for_outbound_sockets=127.18.70.129
--tserver_master_addrs=127.18.70.190:44799
--webserver_port=39055
--webserver_interface=127.18.70.129
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:01:58.821180 17053 sys_catalog.cc:263] Verifying existing consensus state
I20260812 07:01:58.825693 17053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Bootstrap starting.
I20260812 07:01:58.847738 17053 log.cc:824] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Log is configured to *not* fsync() on all Append() calls
I20260812 07:01:58.864552 17053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 07:01:58.865103 17053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Bootstrap complete.
I20260812 07:01:58.874236 17053 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:58.875125 17053 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4d3f329ac824ae4a440f08b4600f099, State: Initialized, Role: FOLLOWER
I20260812 07:01:58.875748 17053 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:58.875964 17053 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:01:58.876081 17053 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:01:58.876240 17053 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 2 FOLLOWER]: Advancing to term 3
I20260812 07:01:58.880090 17053 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:58.880589 17053 leader_election.cc:302] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4d3f329ac824ae4a440f08b4600f099; no voters:
I20260812 07:01:58.881260 17053 leader_election.cc:288] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 07:01:58.881424 17059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 07:01:58.882540 17059 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [term 3 LEADER]: Becoming Leader. State: Replica: f4d3f329ac824ae4a440f08b4600f099, State: Running, Role: LEADER
I20260812 07:01:58.883097 17059 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } }
I20260812 07:01:58.883443 17053 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:01:58.886075 17062 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4d3f329ac824ae4a440f08b4600f099. Latest consensus state: current_term: 3 leader_uuid: "f4d3f329ac824ae4a440f08b4600f099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } } }
I20260812 07:01:58.886461 17062 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: This master's current role is: LEADER
I20260812 07:01:58.885825 17061 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f4d3f329ac824ae4a440f08b4600f099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d3f329ac824ae4a440f08b4600f099" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 44799 } } }
I20260812 07:01:58.887005 17061 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099 [sys.catalog]: This master's current role is: LEADER
I20260812 07:01:58.895778 17073 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:01:58.904971 17073 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:01:58.906525 17073 catalog_manager.cc:1259] Loaded cluster ID: 2c39207269da4c0e8425b520df7adae3
I20260812 07:01:58.906685 17073 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:01:58.910763 17073 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:01:58.912513 17073 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Loaded TSK: 0
I20260812 07:01:58.912669 17073 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f4d3f329ac824ae4a440f08b4600f099: Loaded TSK: 1
F20260812 07:01:58.913878 17073 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f6e3cd2b9ad google::LogMessage::Fail() at ??:0
@ 0x7f6e3cd2e88a google::LogMessage::SendToLog() at ??:0
@ 0x7f6e3cd2b4de google::LogMessage::Flush() at ??:0
@ 0x7f6e3cd2ca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6e40a8f7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f6e40a7e73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f6e5275a1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f6e52759783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f6e527e52a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f6e527e50c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f6e5282f5e9 std::function<>::operator()() at ??:0
@ 0x7f6e5275dcdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f6e5275bc36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f6e527e3610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f6e527e3439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6e3f977345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6e3f97a91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f6e3f97a799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6e3f955eaf kudu::Thread::SuperviseThread() at ??:0
I20260812 07:01:59.014262 17094 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f6e42c2f6db start_thread at ??:0
@ 0x7f6e3bbc561f clone at ??:0
W20260812 07:01:59.242973 17055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:01:59.243294 17055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:01:59.243433 17055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:01:59.250924 17055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:01:59.251037 17055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:01:59.251192 17055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:01:59.261220 17055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:44829
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=39055
--tserver_master_addrs=127.18.70.190:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:01:59.262657 17055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:01:59.264019 17055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:01:59.277493 17132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:59.277446 17141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:59.277383 17133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:01:59.278604 17055 server_base.cc:1034] running on GCE node
I20260812 07:01:59.279232 17055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:01:59.280160 17055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:01:59.281359 17055 hybrid_clock.cc:648] HybridClock initialized: now 1786518119281309 us; error 56 us; skew 500 ppm
I20260812 07:01:59.281687 17055 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:01:59 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518119, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:01:59.285066 17055 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 07:01:59.286629 17055 webserver.cc:460] Webserver started at http://127.18.70.129:39055/ using document root <none> and password file <none>
I20260812 07:01:59.287353 17055 fs_manager.cc:359] Metadata directory not provided
I20260812 07:01:59.287490 17055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:01:59.293021 17055 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 07:01:59.296022 17149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:59.297387 17055 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 07:01:59.297551 17055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "c707053729dc4385a775930f7cdf3e66"
format_stamp: "Formatted at 2026-08-12 07:01:13 on dist-test-slave-tc2s"
server_key: "a5cfe7b447a42c212f56f0908d527ac9"
server_key_iv: "317e5b2ebadd12203c6825944ec4fde0"
server_key_version: "encryptionkey@0"
I20260812 07:01:59.298578 17055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:01:59.315979 17055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:01:59.320135 17055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:01:59.320456 17055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:01:59.321489 17055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:01:59.323451 17157 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260812 07:01:59.328995 17157 ts_tablet_manager.cc:1852] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260812 07:01:59.330109 17157 ts_tablet_manager.cc:1905] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:01:59.337641 17157 ts_tablet_manager.cc:1918] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:01:59.337839 17157 log.cc:1196] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/92a55b38d5024f62907b43889f17a6dd
I20260812 07:01:59.338320 17157 ts_tablet_manager.cc:1939] T 92a55b38d5024f62907b43889f17a6dd P c707053729dc4385a775930f7cdf3e66: Deleting consensus metadata
I20260812 07:01:59.338698 17055 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260812 07:01:59.338814 17055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.016s user 0.001s sys 0.000s
I20260812 07:01:59.338958 17055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:01:59.339032 17055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:59.372567 17055 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:44829
I20260812 07:01:59.372643 17349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:44829 every 8 connection(s)
I20260812 07:01:59.373945 17055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:01:59.378953 17354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:59.376985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:52965)
0812 07:01:59.377775 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:59.378110 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":318,"threads_started":1}
W20260812 07:01:59.379514 17350 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:44799 (0 consecutive failures): Network error: Failed to ping master at 127.18.70.190:44799: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
I20260812 07:01:59.380326 17354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:59.380014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:48421)
0812 07:01:59.380149 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:59.380216 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 07:01:59.381168 17354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:59.380857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:35411)
0812 07:01:59.380986 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:59.381056 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 07:01:59.381443 17350 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 07:01:59.383116 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 17055
I20260812 07:01:59.383770 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:39831
--local_ip_for_outbound_sockets=127.18.70.130
--tserver_master_addrs=127.18.70.190:44799
--webserver_port=42153
--webserver_interface=127.18.70.130
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:01:59.743968 17357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:01:59.744271 17357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:01:59.744417 17357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:01:59.752573 17357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:01:59.752686 17357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:01:59.752844 17357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:01:59.762499 17357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:39831
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=42153
--tserver_master_addrs=127.18.70.190:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:01:59.763801 17357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:01:59.765120 17357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:01:59.778203 17366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:59.778179 17367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:01:59.779565 17371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:01:59.780256 17357 server_base.cc:1034] running on GCE node
I20260812 07:01:59.780862 17357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:01:59.781975 17357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:01:59.783203 17357 hybrid_clock.cc:648] HybridClock initialized: now 1786518119783148 us; error 43 us; skew 500 ppm
I20260812 07:01:59.783548 17357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:01:59 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518119, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:01:59.786744 17357 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 07:01:59.790341 17357 webserver.cc:460] Webserver started at http://127.18.70.130:42153/ using document root <none> and password file <none>
I20260812 07:01:59.791152 17357 fs_manager.cc:359] Metadata directory not provided
I20260812 07:01:59.791296 17357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:01:59.800159 17357 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.005s sys 0.003s
I20260812 07:01:59.803640 17383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:59.805426 17357 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 07:01:59.805627 17357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "4057f7cead5a405fab5ef9d35f697042"
format_stamp: "Formatted at 2026-08-12 07:01:13 on dist-test-slave-tc2s"
server_key: "b5e884a10f1efaa2129e1a09f9a3b6fc"
server_key_iv: "8db939aeb0a90b1c936612696599bc26"
server_key_version: "encryptionkey@0"
I20260812 07:01:59.807160 17357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:01:59.833801 17357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:01:59.838192 17357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:01:59.838459 17357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:01:59.839462 17357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:01:59.840833 17357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:01:59.840921 17357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:59.841034 17357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:01:59.841104 17357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:01:59.872746 17357 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:39831
I20260812 07:01:59.872779 17584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:39831 every 8 connection(s)
I20260812 07:01:59.874212 17357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:01:59.879065 17588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:59.877124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:38267)
0812 07:01:59.877843 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:59.878209 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":263,"threads_started":1}
W20260812 07:01:59.879689 17585 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:44799 (0 consecutive failures): Network error: Failed to ping master at 127.18.70.190:44799: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
I20260812 07:01:59.880465 17588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:59.880151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:59101)
0812 07:01:59.880271 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:59.880346 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 07:01:59.881284 17588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:01:59.880968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:56193)
0812 07:01:59.881101 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 07:01:59.881182 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 07:01:59.881539 17585 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 07:01:59.883613 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 17357
I20260812 07:01:59.884338 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:35737
--local_ip_for_outbound_sockets=127.18.70.131
--tserver_master_addrs=127.18.70.190:44799
--webserver_port=43791
--webserver_interface=127.18.70.131
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:00.224017 17589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:00.224274 17589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:00.224407 17589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:00.231998 17589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:00.232103 17589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:00.232256 17589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:02:00.242835 17589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:35737
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=43791
--tserver_master_addrs=127.18.70.190:44799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:00.244025 17589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:00.245252 17589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:00.257674 17597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:00.257735 17599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:00.257761 17602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:00.258507 17589 server_base.cc:1034] running on GCE node
I20260812 07:02:00.259102 17589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:00.260049 17589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:00.261333 17589 hybrid_clock.cc:648] HybridClock initialized: now 1786518120261275 us; error 46 us; skew 500 ppm
I20260812 07:02:00.261629 17589 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:00 dist-test-slave-tc2s krb5kdc[15063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518120, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:00.264570 17589 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 07:02:00.265862 17589 webserver.cc:460] Webserver started at http://127.18.70.131:43791/ using document root <none> and password file <none>
I20260812 07:02:00.266521 17589 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:00.266639 17589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:00.273135 17589 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 07:02:00.275770 17615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:00.276970 17589 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 07:02:00.277114 17589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "d744846754024e208653c976052df17d"
format_stamp: "Formatted at 2026-08-12 07:01:14 on dist-test-slave-tc2s"
server_key: "7b10300bbc0e512555f114c270ba1fed"
server_key_iv: "13bddda4e935a979e4a296054b7332a0"
server_key_version: "encryptionkey@0"
I20260812 07:02:00.278070 17589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:00.293026 17589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:00.296777 17589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:00.297014 17589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:00.297924 17589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:00.299158 17589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:00.299252 17589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:00.299347 17589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:00.299422 17589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:00.328886 17589 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:35737
I20260812 07:02:00.328956 17809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:35737 every 8 connection(s)
I20260812 07:02:00.330281 17589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:02:00.331282 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 17589
I20260812 07:02:00.335203 17818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:00.333478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:59191)
0812 07:02:00.334206 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:00.334431 (+ 225us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":271,"threads_started":1}
W20260812 07:02:00.335922 17810 heartbeater.cc:644] Failed to heartbeat to 127.18.70.190:44799 (0 consecutive failures): Network error: Failed to ping master at 127.18.70.190:44799: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
I20260812 07:02:00.336691 17818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:00.336405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:38513)
0812 07:02:00.336528 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:00.336592 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 07:02:00.337457 17818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:00.337163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:32999)
0812 07:02:00.337288 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:00.337356 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 07:02:00.337666 17810 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 07:02:00.382793 17819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:00.382018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:54691)
0812 07:02:00.382466 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:00.382555 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":210,"threads_started":1}
I20260812 07:02:00.883386 17820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:00.882177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:60905)
0812 07:02:00.882785 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:00.882900 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":314,"threads_started":1}
I20260812 07:02:01.339260 17821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:01.338390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:58733)
0812 07:02:01.338896 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:01.339016 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":247,"threads_started":1}
I20260812 07:02:01.384631 17824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:01.383806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:46819)
0812 07:02:01.384363 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:01.384459 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":280,"threads_started":1}
I20260812 07:02:01.885103 17826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:01.884331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:51851)
0812 07:02:01.884795 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:01.884884 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":217,"threads_started":1}
I20260812 07:02:02.340848 17827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:02.340126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:52129)
0812 07:02:02.340605 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:02.340685 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":252,"threads_started":1}
I20260812 07:02:02.386281 17831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:02.385560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:34317)
0812 07:02:02.386020 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:02.386108 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":202,"threads_started":1}
I20260812 07:02:02.887120 17832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:02.886122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:59783)
0812 07:02:02.886738 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:02.886858 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":368,"threads_started":1}
I20260812 07:02:03.342428 17834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:03.341695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:42763)
0812 07:02:03.342162 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:03.342243 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":270,"threads_started":1}
I20260812 07:02:03.387715 17835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:03.387026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:33345)
0812 07:02:03.387480 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:03.387561 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":228,"threads_started":1}
I20260812 07:02:03.888690 17836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:03.888031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:45893)
0812 07:02:03.888442 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:03.888520 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":198,"threads_started":1}
I20260812 07:02:04.343977 17837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:04.343221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:40869)
0812 07:02:04.343622 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:04.343702 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":199,"threads_started":1}
I20260812 07:02:04.389293 17840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:04.388488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:49447)
0812 07:02:04.389019 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:04.389120 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":264,"threads_started":1}
I20260812 07:02:04.890385 17842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:04.889469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:51315)
0812 07:02:04.890094 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:04.890209 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":253,"threads_started":1}
I20260812 07:02:05.345975 17843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:05.345019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:41379)
0812 07:02:05.345617 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:05.345715 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":319,"threads_started":1}
I20260812 07:02:05.391683 17844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:05.390382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:37093)
0812 07:02:05.391114 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:05.391273 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":329,"threads_started":1}
I20260812 07:02:05.891844 17845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:05.891162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:45735)
0812 07:02:05.891597 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:05.891683 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":233,"threads_started":1}
I20260812 07:02:06.347502 17846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:06.346834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:49821)
0812 07:02:06.347255 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:06.347344 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":213,"threads_started":1}
I20260812 07:02:06.393294 17848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:06.392557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:58545)
0812 07:02:06.393014 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:06.393099 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":208,"threads_started":1}
I20260812 07:02:06.893463 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:06.892679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:60501)
0812 07:02:06.893158 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:06.893237 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":222,"threads_started":1}
I20260812 07:02:07.349054 17851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:07.348300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:36379)
0812 07:02:07.348756 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:07.348835 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":208,"threads_started":1}
I20260812 07:02:07.394711 17854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:07.394070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:53681)
0812 07:02:07.394479 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:07.394559 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":202,"threads_started":1}
I20260812 07:02:07.895057 17858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:07.894346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:57635)
0812 07:02:07.894779 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:07.894857 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":227,"threads_started":1}
I20260812 07:02:08.350574 17859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:08.349840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:51191)
0812 07:02:08.350330 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:08.350413 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":278,"threads_started":1}
I20260812 07:02:08.396183 17861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:08.395485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:41521)
0812 07:02:08.395928 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:08.396021 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":215,"threads_started":1}
I20260812 07:02:08.896598 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:08.895823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:34929)
0812 07:02:08.896295 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:08.896380 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":234,"threads_started":1}
I20260812 07:02:09.352109 17863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:09.351395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:34183)
0812 07:02:09.351849 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:09.351932 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":216,"threads_started":1}
I20260812 07:02:09.397728 17864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:09.397044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:32819)
0812 07:02:09.397474 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:09.397555 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":217,"threads_started":1}
I20260812 07:02:09.898207 17866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:09.897402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:42197)
0812 07:02:09.897876 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:09.897993 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":265,"threads_started":1}
I20260812 07:02:10.353691 17868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:10.352970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:32785)
0812 07:02:10.353423 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:10.353525 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":231,"threads_started":1}
I20260812 07:02:10.399318 17870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:10.398551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:36249)
0812 07:02:10.399051 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:10.399130 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":279,"threads_started":1}
I20260812 07:02:10.899776 17872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:10.899024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:48065)
0812 07:02:10.899478 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:10.899596 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":212,"threads_started":1}
I20260812 07:02:11.355432 17875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:11.354715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:37373)
0812 07:02:11.355133 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:11.355225 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":212,"threads_started":1}
I20260812 07:02:11.400903 17876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:11.400217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:44851)
0812 07:02:11.400655 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:11.400740 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":235,"threads_started":1}
I20260812 07:02:11.901430 17877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:11.900661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:45423)
0812 07:02:11.901142 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:11.901242 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":256,"threads_started":1}
I20260812 07:02:12.357041 17878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:12.356371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:50051)
0812 07:02:12.356792 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:12.356884 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":214,"threads_started":1}
I20260812 07:02:12.402556 17883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:12.401689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:54349)
0812 07:02:12.402234 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:12.402337 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":302,"threads_started":1}
I20260812 07:02:12.903070 17884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:12.902259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:39247)
0812 07:02:12.902724 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:12.902845 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":236,"threads_started":1}
I20260812 07:02:13.358973 17885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:13.358013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:45677)
0812 07:02:13.358593 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:13.358729 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":308,"threads_started":1}
I20260812 07:02:13.404057 17886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:13.403288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:38491)
0812 07:02:13.403751 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:13.403845 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":252,"threads_started":1}
I20260812 07:02:13.904582 17887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:13.903864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:46139)
0812 07:02:13.904295 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:13.904381 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":223,"threads_started":1}
I20260812 07:02:14.360486 17889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:14.359801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:48149)
0812 07:02:14.360205 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:14.360288 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":212,"threads_started":1}
I20260812 07:02:14.405799 17890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:14.405093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.129:54303)
0812 07:02:14.405524 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:14.405614 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":221,"threads_started":1}
I20260812 07:02:14.906368 17893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:14.905583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.130:37733)
0812 07:02:14.906068 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:14.906179 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":216,"threads_started":1}
I20260812 07:02:15.341472 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 17055
I20260812 07:02:15.362443 17896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:15.361568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:44799 (local address 127.18.70.131:33059)
0812 07:02:15.362118 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:15.362221 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.190:44799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":247,"threads_started":1}
I20260812 07:02:15.364289 17895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:15.342839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56346 (local address 127.18.70.129:44829)
0812 07:02:15.343422 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:15.343441 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:15.343497 (+ 56us) server_negotiation.cc:407] Connection header received
0812 07:02:15.345371 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:15.345381 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:15.345800 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:15.346147 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:15.347621 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:15.348922 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:15.350220 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:15.350888 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:15.351070 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:15.357937 (+ 6867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:15.357950 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:15.357968 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:15.358008 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:15.360921 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:15.361722 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:15.361731 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:15.361741 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:15.362003 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:15.362377 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:15.362382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:15.362385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:15.363051 (+ 666us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:15.363283 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:15.363675 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 07:02:15.364016 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":849,"threads_started":1}
I20260812 07:02:15.365626 17342 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:15.454386 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 17055
I20260812 07:02:15.483978 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 17357
I20260812 07:02:15.501266 17900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:15.484830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51734 (local address 127.18.70.130:39831)
0812 07:02:15.485378 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:15.485393 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:15.485432 (+ 39us) server_negotiation.cc:407] Connection header received
0812 07:02:15.487119 (+ 1687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:15.487130 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:15.487547 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:15.487874 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:15.489339 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:15.490632 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:15.491979 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:15.492634 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:15.492809 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:15.495378 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:15.495387 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:15.495400 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:15.495437 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:15.498140 (+ 2703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:15.498778 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:15.498784 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:15.498790 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:15.498966 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:15.499329 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:15.499333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:15.499335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:15.499834 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:15.500142 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:15.500594 (+ 452us) server_negotiation.cc:299] Negotiation successful
0812 07:02:15.500984 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":233,"threads_started":1}
I20260812 07:02:15.502795 17573 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:15.585521 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 17357
I20260812 07:02:15.609266 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 17589
I20260812 07:02:15.626533 17903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:15.610373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52452 (local address 127.18.70.131:35737)
0812 07:02:15.610979 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:15.610994 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:15.611037 (+ 43us) server_negotiation.cc:407] Connection header received
0812 07:02:15.612807 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:15.612820 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:15.613295 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:15.613623 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:15.614940 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:15.616190 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:15.617405 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:15.618077 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:15.618204 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:15.620762 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:15.620769 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:15.620782 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:15.620817 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:15.623613 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:15.624280 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:15.624286 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:15.624291 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:15.624451 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:15.624736 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:15.624739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:15.624741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:15.625223 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:15.625444 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:15.625810 (+ 366us) server_negotiation.cc:299] Negotiation successful
0812 07:02:15.626213 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":268,"threads_started":1}
I20260812 07:02:15.627904 17796 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:15.710891 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 17589
2026-08-12T07:02:15Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64746 ms)
[----------] 30 tests from SecurityITest (303468 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:15 dist-test-slave-tc2s krb5kdc[17908](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:15 dist-test-slave-tc2s krb5kdc[17908](info): set up 2 sockets
Aug 12 07:02:15 dist-test-slave-tc2s krb5kdc[17908](info): commencing operation
krb5kdc: starting...
W20260812 07:02:16.980858 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.003s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:17 dist-test-slave-tc2s krb5kdc[17908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:02:17.259070 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41289
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:41289
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:17.607882 17930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:17.608175 17930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:17.608314 17930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:17.615629 17930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:17.615763 17930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:17.615835 17930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:17.615927 17930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:17.615990 17930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:17.626325 17930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:41289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:17.627631 17930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:17.628921 17930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:17.641327 17944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:17.641356 17939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:17.641404 17938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:17.641975 17930 server_base.cc:1034] running on GCE node
I20260812 07:02:17.642889 17930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:17.644424 17930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:17.645634 17930 hybrid_clock.cc:648] HybridClock initialized: now 1786518137645580 us; error 47 us; skew 500 ppm
I20260812 07:02:17.646023 17930 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:17 dist-test-slave-tc2s krb5kdc[17908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518137, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:17.649086 17930 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:02:17.650723 17930 webserver.cc:460] Webserver started at http://127.18.70.190:35545/ using document root <none> and password file <none>
I20260812 07:02:17.651459 17930 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:17.651582 17930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:17.651875 17930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:17.655103 17930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "dccfbfffb1554a01999cffc6a32577fe"
format_stamp: "Formatted at 2026-08-12 07:02:17 on dist-test-slave-tc2s"
server_key: "b463dd8cdce3fbdf3b260016678c0ad6"
server_key_iv: "e7205b36f1e2cc6b5b80cc89e86ed1bb"
server_key_version: "encryptionkey@0"
I20260812 07:02:17.655905 17930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "dccfbfffb1554a01999cffc6a32577fe"
format_stamp: "Formatted at 2026-08-12 07:02:17 on dist-test-slave-tc2s"
server_key: "b463dd8cdce3fbdf3b260016678c0ad6"
server_key_iv: "e7205b36f1e2cc6b5b80cc89e86ed1bb"
server_key_version: "encryptionkey@0"
I20260812 07:02:17.661674 17930 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 07:02:17.665153 17960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:17.666594 17930 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:02:17.666772 17930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "dccfbfffb1554a01999cffc6a32577fe"
format_stamp: "Formatted at 2026-08-12 07:02:17 on dist-test-slave-tc2s"
server_key: "b463dd8cdce3fbdf3b260016678c0ad6"
server_key_iv: "e7205b36f1e2cc6b5b80cc89e86ed1bb"
server_key_version: "encryptionkey@0"
I20260812 07:02:17.666970 17930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:17.686194 17930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:17.690148 17930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:17.690426 17930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:17.708978 17930 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:41289
I20260812 07:02:17.708999 18063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:41289 every 8 connection(s)
I20260812 07:02:17.710397 17930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:17.714293 18064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:17.715688 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 17930
I20260812 07:02:17.715922 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:17.716778 18714 external_mini_cluster.cc:1428] Setting key 9e49f7a6f6c9d1f5110c2a3c4da620fc
I20260812 07:02:17.729075 18064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe: Bootstrap starting.
Aug 12 07:02:17 dist-test-slave-tc2s krb5kdc[17908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:17.732533 18064 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:17.733719 18064 log.cc:824] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:17.736793 18064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe: No bootstrap required, opened a new log
I20260812 07:02:17.740513 18070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:17.718945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54908 (local address 127.18.70.190:41289)
0812 07:02:17.719714 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:17.719733 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:17.719794 (+ 61us) server_negotiation.cc:407] Connection header received
0812 07:02:17.721560 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:17.721589 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:17.722132 (+ 543us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:17.722567 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:17.723891 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:17.725875 (+ 1984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:17.727363 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:17.728397 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:17.728578 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:17.733042 (+ 4464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:17.733050 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:17.733070 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:17.733112 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:17.736145 (+ 3033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:17.736982 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:17.736991 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:17.737000 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:17.737179 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:17.737640 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:17.737644 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:17.737646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:17.738241 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:17.738457 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:17.739025 (+ 568us) server_negotiation.cc:299] Negotiation successful
0812 07:02:17.739363 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":316,"threads_started":1}
I20260812 07:02:17.745642 18064 raft_consensus.cc:348] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dccfbfffb1554a01999cffc6a32577fe" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41289 } }
I20260812 07:02:17.746065 18064 raft_consensus.cc:374] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:17.746160 18064 raft_consensus.cc:729] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dccfbfffb1554a01999cffc6a32577fe, State: Initialized, Role: FOLLOWER
I20260812 07:02:17.746702 18064 consensus_queue.cc:260] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dccfbfffb1554a01999cffc6a32577fe" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41289 } }
I20260812 07:02:17.746917 18064 raft_consensus.cc:388] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:17.747045 18064 raft_consensus.cc:482] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:17.747198 18064 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:17.749468 18064 raft_consensus.cc:504] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dccfbfffb1554a01999cffc6a32577fe" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41289 } }
I20260812 07:02:17.750036 18064 leader_election.cc:302] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dccfbfffb1554a01999cffc6a32577fe; no voters:
I20260812 07:02:17.750595 18064 leader_election.cc:288] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:17.750725 18074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:17.751380 18074 raft_consensus.cc:686] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [term 1 LEADER]: Becoming Leader. State: Replica: dccfbfffb1554a01999cffc6a32577fe, State: Running, Role: LEADER
I20260812 07:02:17.751919 18074 consensus_queue.cc:237] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dccfbfffb1554a01999cffc6a32577fe" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41289 } }
I20260812 07:02:17.752496 18064 sys_catalog.cc:564] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:17.754473 18077 sys_catalog.cc:455] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader dccfbfffb1554a01999cffc6a32577fe. Latest consensus state: current_term: 1 leader_uuid: "dccfbfffb1554a01999cffc6a32577fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dccfbfffb1554a01999cffc6a32577fe" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41289 } } }
I20260812 07:02:17.754823 18077 sys_catalog.cc:458] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:17.755717 18076 sys_catalog.cc:455] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dccfbfffb1554a01999cffc6a32577fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dccfbfffb1554a01999cffc6a32577fe" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41289 } } }
I20260812 07:02:17.755954 18076 sys_catalog.cc:458] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:17.757205 18088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:17.762818 18088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:17.772166 18088 catalog_manager.cc:1347] Generated new cluster ID: 19b17173c02746928c71b47ea3379e73
I20260812 07:02:17.772269 18088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:17.801942 18088 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:17.803282 18088 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:17.813977 18088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe: Generated new TSK 0
I20260812 07:02:17.814751 18088 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 07:02:17.887322 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41289
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:18.223127 18122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:18.223400 18122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:18.223546 18122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:18.230643 18122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:18.230756 18122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:18.230921 18122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:02:18.240567 18122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41289
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:18.241748 18122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:18.243057 18122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:18.255597 18128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:18.255688 18129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:18.255661 18136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:18.256448 18122 server_base.cc:1034] running on GCE node
I20260812 07:02:18.257028 18122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:18.257990 18122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:18.259189 18122 hybrid_clock.cc:648] HybridClock initialized: now 1786518138259143 us; error 41 us; skew 500 ppm
I20260812 07:02:18.259490 18122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:18 dist-test-slave-tc2s krb5kdc[17908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518138, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:18.262548 18122 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 07:02:18.263903 18122 webserver.cc:460] Webserver started at http://127.18.70.129:33393/ using document root <none> and password file <none>
I20260812 07:02:18.264520 18122 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:18.264621 18122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:18.264873 18122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:18.267627 18122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "91573c9a14ea4316aec65b438ca2dfd7"
format_stamp: "Formatted at 2026-08-12 07:02:18 on dist-test-slave-tc2s"
server_key: "e2fe77feb509837b180abeaaf0d094c1"
server_key_iv: "90d7038b938faf65bd2bb5a92d0ff213"
server_key_version: "encryptionkey@0"
I20260812 07:02:18.268332 18122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "91573c9a14ea4316aec65b438ca2dfd7"
format_stamp: "Formatted at 2026-08-12 07:02:18 on dist-test-slave-tc2s"
server_key: "e2fe77feb509837b180abeaaf0d094c1"
server_key_iv: "90d7038b938faf65bd2bb5a92d0ff213"
server_key_version: "encryptionkey@0"
I20260812 07:02:18.273190 18122 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 07:02:18.276413 18152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:18.277599 18122 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 07:02:18.277742 18122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "91573c9a14ea4316aec65b438ca2dfd7"
format_stamp: "Formatted at 2026-08-12 07:02:18 on dist-test-slave-tc2s"
server_key: "e2fe77feb509837b180abeaaf0d094c1"
server_key_iv: "90d7038b938faf65bd2bb5a92d0ff213"
server_key_version: "encryptionkey@0"
I20260812 07:02:18.277942 18122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:18.288077 18122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:18.291616 18122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:18.291865 18122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:18.292747 18122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:18.294013 18122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:18.294086 18122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:18.294202 18122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:18.294255 18122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:18.324474 18122 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:43859
I20260812 07:02:18.324522 18381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:43859 every 8 connection(s)
I20260812 07:02:18.325688 18122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:02:18.335654 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 18122
I20260812 07:02:18.335870 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 07:02:18.336577 18714 external_mini_cluster.cc:1428] Setting key c8d45dd49f23a95132209480dafabeeb
Aug 12 07:02:18 dist-test-slave-tc2s krb5kdc[17908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518138, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:18.345609 18387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:18.328135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:46475 (local address 127.18.70.190:41289)
0812 07:02:18.328607 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:18.328613 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:18.329512 (+ 899us) server_negotiation.cc:407] Connection header received
0812 07:02:18.331355 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:18.331360 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:18.331430 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:18.331517 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:18.332859 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:18.333588 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:18.335155 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:18.335764 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:18.335902 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:18.339461 (+ 3559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:18.339467 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:18.339471 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:18.339508 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:18.342656 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:18.343370 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:18.343375 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:18.343378 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:18.343527 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:18.343954 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:18.343958 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:18.343961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:18.344277 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:18.344425 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:18.345040 (+ 615us) server_negotiation.cc:299] Negotiation successful
0812 07:02:18.345249 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":206,"threads_started":1}
I20260812 07:02:18.346347 18389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:18.328684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41289 (local address 127.18.70.129:46475)
0812 07:02:18.329360 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:18.329398 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:18.331097 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:18.331694 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:18.331701 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:18.332194 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:18.332725 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:18.332743 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:18.333722 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:18.333726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:18.335009 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:18.335023 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:18.336013 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:18.336021 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:18.336213 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:18.336869 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:02:18.336900 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:18.339234 (+ 2334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:18.342807 (+ 3573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:18.342814 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:18.342825 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:18.343243 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:18.343646 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:18.343650 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:18.343652 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:18.343843 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:18.344392 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:18.344398 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:18.344673 (+ 275us) client_negotiation.cc:769] Sending connection context
0812 07:02:18.344892 (+ 219us) client_negotiation.cc:240] Negotiation successful
0812 07:02:18.345242 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":261,"threads_started":1}
I20260812 07:02:18.347752 18383 heartbeater.cc:347] Connected to a master server at 127.18.70.190:41289
I20260812 07:02:18.348064 18383 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:18.348848 18383 heartbeater.cc:511] Master 127.18.70.190:41289 requested a full tablet report, sending...
I20260812 07:02:18.350998 17990 ts_manager.cc:194] Registered new tserver with Master: 91573c9a14ea4316aec65b438ca2dfd7 (127.18.70.129:43859)
I20260812 07:02:18.352468 17990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:46475
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 07:02:18.394781 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41289
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:18.719112 18394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:18.719416 18394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:18.719574 18394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:18.726698 18394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:18.726802 18394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:18.726948 18394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:02:18.736099 18394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41289
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:18.737146 18394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:18.738386 18394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:18.750572 18411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:18.750612 18405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:18.750650 18404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:18.751454 18394 server_base.cc:1034] running on GCE node
I20260812 07:02:18.752027 18394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:18.752887 18394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:18.754081 18394 hybrid_clock.cc:648] HybridClock initialized: now 1786518138754037 us; error 26 us; skew 500 ppm
I20260812 07:02:18.754391 18394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:18 dist-test-slave-tc2s krb5kdc[17908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518138, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:18.757373 18394 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 07:02:18.761042 18394 webserver.cc:460] Webserver started at http://127.18.70.130:38617/ using document root <none> and password file <none>
I20260812 07:02:18.761680 18394 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:18.761801 18394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:18.762128 18394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:18.764858 18394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "db97f880a16a496787096fa95199ccb0"
format_stamp: "Formatted at 2026-08-12 07:02:18 on dist-test-slave-tc2s"
server_key: "7d2c04c57a87653357ef6ae1cc19bf24"
server_key_iv: "5ad8b33de6c4626bce69f2c9781e50da"
server_key_version: "encryptionkey@0"
I20260812 07:02:18.765731 18394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "db97f880a16a496787096fa95199ccb0"
format_stamp: "Formatted at 2026-08-12 07:02:18 on dist-test-slave-tc2s"
server_key: "7d2c04c57a87653357ef6ae1cc19bf24"
server_key_iv: "5ad8b33de6c4626bce69f2c9781e50da"
server_key_version: "encryptionkey@0"
I20260812 07:02:18.770699 18394 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 07:02:18.773921 18424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:18.775061 18394 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 07:02:18.775206 18394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "db97f880a16a496787096fa95199ccb0"
format_stamp: "Formatted at 2026-08-12 07:02:18 on dist-test-slave-tc2s"
server_key: "7d2c04c57a87653357ef6ae1cc19bf24"
server_key_iv: "5ad8b33de6c4626bce69f2c9781e50da"
server_key_version: "encryptionkey@0"
I20260812 07:02:18.775389 18394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:18.788352 18394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:18.792124 18394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:18.792372 18394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:18.793217 18394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:18.794461 18394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:18.794535 18394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:18.794656 18394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:18.794715 18394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:18.826462 18394 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:35063
I20260812 07:02:18.826501 18617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:35063 every 8 connection(s)
I20260812 07:02:18.827620 18394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:02:18.836090 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 18394
I20260812 07:02:18.836274 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 07:02:18.836859 18714 external_mini_cluster.cc:1428] Setting key 57062eef50ad4f197dc540cbe633950e
Aug 12 07:02:18 dist-test-slave-tc2s krb5kdc[17908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518138, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:18.847003 18387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:18.829910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:38809 (local address 127.18.70.190:41289)
0812 07:02:18.830081 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:18.830086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:18.831166 (+ 1080us) server_negotiation.cc:407] Connection header received
0812 07:02:18.832956 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:18.832962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:18.833041 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:18.833127 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:18.834559 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:18.835260 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:18.837410 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:18.837970 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:18.838068 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:18.841615 (+ 3547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:18.841620 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:18.841623 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:18.841654 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:18.844100 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:18.844771 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:18.844775 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:18.844777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:18.844914 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:18.845319 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:18.845323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:18.845325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:18.845589 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:18.845721 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:18.846431 (+ 710us) server_negotiation.cc:299] Negotiation successful
0812 07:02:18.846661 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 07:02:18.847780 18623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:18.830342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41289 (local address 127.18.70.130:38809)
0812 07:02:18.831015 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:18.831060 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:18.832692 (+ 1632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:18.833353 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:18.833361 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:18.833836 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:18.834399 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:18.834417 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:18.835399 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:18.835403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:18.837243 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:18.837258 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:18.838189 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:18.838197 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:18.838465 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:18.839123 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:02:18.839145 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:18.841402 (+ 2257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:18.844237 (+ 2835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:18.844246 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:18.844259 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:18.844658 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:18.845018 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:18.845024 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:18.845028 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:18.845212 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:18.845713 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:18.845721 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:18.846062 (+ 341us) client_negotiation.cc:769] Sending connection context
0812 07:02:18.846290 (+ 228us) client_negotiation.cc:240] Negotiation successful
0812 07:02:18.846758 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":259,"threads_started":1}
I20260812 07:02:18.849155 18619 heartbeater.cc:347] Connected to a master server at 127.18.70.190:41289
I20260812 07:02:18.849450 18619 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:18.850214 18619 heartbeater.cc:511] Master 127.18.70.190:41289 requested a full tablet report, sending...
I20260812 07:02:18.851786 17990 ts_manager.cc:194] Registered new tserver with Master: db97f880a16a496787096fa95199ccb0 (127.18.70.130:35063)
I20260812 07:02:18.852840 17990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:38809
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 07:02:18.893355 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41289
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:19.221678 18628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:19.221966 18628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:19.222198 18628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:19.229388 18628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:19.229486 18628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:19.229632 18628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:02:19.239581 18628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:41289
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:19.240746 18628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:19.241988 18628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:19.254511 18638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:19.254537 18645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:19.254588 18640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:19.255398 18628 server_base.cc:1034] running on GCE node
I20260812 07:02:19.255944 18628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:19.256785 18628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:19.257978 18628 hybrid_clock.cc:648] HybridClock initialized: now 1786518139257917 us; error 43 us; skew 500 ppm
I20260812 07:02:19.258327 18628 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:19 dist-test-slave-tc2s krb5kdc[17908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518139, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:19.261293 18628 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 07:02:19.262674 18628 webserver.cc:460] Webserver started at http://127.18.70.131:35823/ using document root <none> and password file <none>
I20260812 07:02:19.263290 18628 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:19.263458 18628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:19.263749 18628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:19.266522 18628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "2c3df79f7fe64e73a29b591fe85c6a9b"
format_stamp: "Formatted at 2026-08-12 07:02:19 on dist-test-slave-tc2s"
server_key: "b683c64f67a30447f6c335cad2237a79"
server_key_iv: "de27eaea6592fcc0ecdd756d25cd1ad7"
server_key_version: "encryptionkey@0"
I20260812 07:02:19.267251 18628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "2c3df79f7fe64e73a29b591fe85c6a9b"
format_stamp: "Formatted at 2026-08-12 07:02:19 on dist-test-slave-tc2s"
server_key: "b683c64f67a30447f6c335cad2237a79"
server_key_iv: "de27eaea6592fcc0ecdd756d25cd1ad7"
server_key_version: "encryptionkey@0"
I20260812 07:02:19.272460 18628 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 07:02:19.275746 18653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:19.276959 18628 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 07:02:19.277110 18628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "2c3df79f7fe64e73a29b591fe85c6a9b"
format_stamp: "Formatted at 2026-08-12 07:02:19 on dist-test-slave-tc2s"
server_key: "b683c64f67a30447f6c335cad2237a79"
server_key_iv: "de27eaea6592fcc0ecdd756d25cd1ad7"
server_key_version: "encryptionkey@0"
I20260812 07:02:19.277281 18628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:19.312059 18628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:19.316058 18628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:19.316321 18628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:19.317222 18628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:19.318499 18628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:19.318586 18628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:19.318704 18628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:19.318756 18628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:19.349732 18628 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:45173
I20260812 07:02:19.349787 18889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:45173 every 8 connection(s)
I20260812 07:02:19.350883 18628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:02:19.354833 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 18628
I20260812 07:02:19.355008 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 07:02:19.355420 18383 heartbeater.cc:503] Master 127.18.70.190:41289 was elected leader, sending a full tablet report...
I20260812 07:02:19.355571 18714 external_mini_cluster.cc:1428] Setting key 9ca9ec654d892e6ddce91fe0f8095053
Aug 12 07:02:19 dist-test-slave-tc2s krb5kdc[17908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518139, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:19.369513 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.353089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:43625 (local address 127.18.70.190:41289)
0812 07:02:19.353589 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:19.353595 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:19.354454 (+ 859us) server_negotiation.cc:407] Connection header received
0812 07:02:19.356409 (+ 1955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:19.356415 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:19.356504 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:19.356623 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:19.358433 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.359236 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.360686 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.361091 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.361191 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.364318 (+ 3127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:19.364323 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:19.364326 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:19.364356 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:19.366887 (+ 2531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:19.367512 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:19.367516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:19.367518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:19.367640 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:19.367963 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:19.367966 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:19.367968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:19.368213 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:19.368326 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:19.368970 (+ 644us) server_negotiation.cc:299] Negotiation successful
0812 07:02:19.369153 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":217,"threads_started":1}
I20260812 07:02:19.370441 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.353647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:41289 (local address 127.18.70.131:43625)
0812 07:02:19.354298 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:19.354335 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:19.356134 (+ 1799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:19.356901 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:19.356911 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:19.357609 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:19.358249 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.358276 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.359370 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.359374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.360564 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.360577 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.361263 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.361268 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.361452 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.362095 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:02:19.362118 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:19.364139 (+ 2021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:19.367003 (+ 2864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:19.367009 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:19.367018 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:19.367424 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:19.367715 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:19.367718 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:19.367721 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:19.367884 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:19.368298 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:19.368302 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:19.368576 (+ 274us) client_negotiation.cc:769] Sending connection context
0812 07:02:19.368819 (+ 243us) client_negotiation.cc:240] Negotiation successful
0812 07:02:19.369204 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":277,"threads_started":1}
I20260812 07:02:19.371659 18890 heartbeater.cc:347] Connected to a master server at 127.18.70.190:41289
I20260812 07:02:19.371893 18890 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:19.372491 18890 heartbeater.cc:511] Master 127.18.70.190:41289 requested a full tablet report, sending...
I20260812 07:02:19.373757 17990 ts_manager.cc:194] Registered new tserver with Master: 2c3df79f7fe64e73a29b591fe85c6a9b (127.18.70.131:45173)
I20260812 07:02:19.374549 17990 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:43625
I20260812 07:02:19.382666 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 07:02:19.398670 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.387282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54912 (local address 127.18.70.190:41289)
0812 07:02:19.387447 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:19.387453 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:19.387894 (+ 441us) server_negotiation.cc:407] Connection header received
0812 07:02:19.388006 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:19.388010 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:19.388065 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:19.388131 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:19.389439 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.390164 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.391359 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.391744 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.391827 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.394142 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:19.394147 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:19.394150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:19.394180 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:19.396459 (+ 2279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:19.397078 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:19.397082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:19.397084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:19.397195 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:19.397474 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:19.397477 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:19.397479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:19.397765 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:19.397999 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:19.398231 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 07:02:19.398404 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 07:02:19.402275 17990 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54912:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 07:02:19.411484 17990 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 07:02:19.433389 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.424294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:45173 (local address 127.0.0.1:45814)
0812 07:02:19.425403 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:19.425421 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:19.425530 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:19.426997 (+ 1467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:19.427001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:19.427024 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:19.427416 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.427429 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.429185 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.429194 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.430891 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.430907 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.432384 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.432390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.432573 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.432622 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 07:02:19.432756 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 07:02:19.432926 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":981,"mutex_wait_us":45,"thread_start_us":869,"threads_started":1}
I20260812 07:02:19.433674 18918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.423587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49770 (local address 127.18.70.130:35063)
0812 07:02:19.425344 (+ 1757us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:19.425368 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:19.425403 (+ 35us) server_negotiation.cc:407] Connection header received
0812 07:02:19.425515 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:19.425524 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:19.425780 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:19.426669 (+ 889us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:19.426902 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.428323 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.431055 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.432463 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.432647 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.432851 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:19.433077 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 07:02:19.433247 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1258,"thread_start_us":1157,"threads_started":1}
I20260812 07:02:19.434053 18921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.424839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45814 (local address 127.18.70.131:45173)
0812 07:02:19.426467 (+ 1628us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:19.426474 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:19.426505 (+ 31us) server_negotiation.cc:407] Connection header received
0812 07:02:19.426588 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:19.426594 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:19.426790 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:19.426991 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:19.427631 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.429058 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.431077 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.432191 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.432304 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.432534 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:19.433603 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0812 07:02:19.433722 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1462,"thread_start_us":1309,"threads_started":1}
I20260812 07:02:19.433503 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.422861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:35063 (local address 127.0.0.1:49770)
0812 07:02:19.424514 (+ 1653us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:19.424532 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:19.424640 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:19.426054 (+ 1414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:19.426062 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:19.426095 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:19.426456 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.426470 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.428445 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.428450 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.430861 (+ 2411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.430876 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.432719 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.432726 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.432903 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.432932 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 07:02:19.433017 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 07:02:19.433142 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1523,"mutex_wait_us":47,"thread_start_us":273,"threads_started":1}
I20260812 07:02:19.433946 18913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.422714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43859 (local address 127.0.0.1:58154)
0812 07:02:19.423489 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:19.423537 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:19.423689 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:19.426642 (+ 2953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:19.426647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:19.426671 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:19.427008 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.427018 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.428848 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.428853 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.431107 (+ 2254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.431121 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.433112 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.433118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.433306 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.433344 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 07:02:19.433443 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 07:02:19.433565 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"mutex_wait_us":43,"thread_start_us":1505,"threads_started":1}
I20260812 07:02:19.434506 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.423046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58154 (local address 127.18.70.129:43859)
0812 07:02:19.426157 (+ 3111us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:19.426166 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:19.426195 (+ 29us) server_negotiation.cc:407] Connection header received
0812 07:02:19.426289 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:19.426296 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:19.426477 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:19.426635 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:19.427205 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.428706 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.431276 (+ 2570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.432648 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.432773 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.432957 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:19.434051 (+ 1094us) server_negotiation.cc:299] Negotiation successful
0812 07:02:19.434187 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2922,"thread_start_us":2732,"threads_started":1}
I20260812 07:02:19.437954 18500 tablet_service.cc:1467] Processing CreateTablet for tablet d0d6c89f56934f86bdb5c2d0465ca62e (DEFAULT_TABLE table=test-table [id=885261721b4b4990a659adf70bf2a99c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:19.438056 18259 tablet_service.cc:1467] Processing CreateTablet for tablet d0d6c89f56934f86bdb5c2d0465ca62e (DEFAULT_TABLE table=test-table [id=885261721b4b4990a659adf70bf2a99c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:19.438067 18752 tablet_service.cc:1467] Processing CreateTablet for tablet d0d6c89f56934f86bdb5c2d0465ca62e (DEFAULT_TABLE table=test-table [id=885261721b4b4990a659adf70bf2a99c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:19.439204 18500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0d6c89f56934f86bdb5c2d0465ca62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:19.439394 18752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0d6c89f56934f86bdb5c2d0465ca62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:19.439409 18259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0d6c89f56934f86bdb5c2d0465ca62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:19.450479 18922 tablet_bootstrap.cc:492] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: Bootstrap starting.
I20260812 07:02:19.453922 18925 tablet_bootstrap.cc:492] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7: Bootstrap starting.
I20260812 07:02:19.454185 18924 tablet_bootstrap.cc:492] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: Bootstrap starting.
I20260812 07:02:19.455031 18922 tablet_bootstrap.cc:654] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:19.456310 18922 log.cc:824] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:19.456743 18924 tablet_bootstrap.cc:654] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:19.457496 18925 tablet_bootstrap.cc:654] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:19.457999 18924 log.cc:824] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:19.458678 18925 log.cc:824] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:19.459559 18922 tablet_bootstrap.cc:492] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: No bootstrap required, opened a new log
I20260812 07:02:19.459867 18922 ts_tablet_manager.cc:1397] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260812 07:02:19.460377 18924 tablet_bootstrap.cc:492] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: No bootstrap required, opened a new log
I20260812 07:02:19.460734 18924 ts_tablet_manager.cc:1397] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 07:02:19.467484 18925 tablet_bootstrap.cc:492] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7: No bootstrap required, opened a new log
I20260812 07:02:19.467744 18925 ts_tablet_manager.cc:1397] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.008s
I20260812 07:02:19.468015 18924 raft_consensus.cc:348] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91573c9a14ea4316aec65b438ca2dfd7" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43859 } } peers { permanent_uuid: "db97f880a16a496787096fa95199ccb0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 35063 } } peers { permanent_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45173 } }
I20260812 07:02:19.468340 18924 raft_consensus.cc:374] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:19.468439 18924 raft_consensus.cc:729] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3df79f7fe64e73a29b591fe85c6a9b, State: Initialized, Role: FOLLOWER
I20260812 07:02:19.468989 18924 consensus_queue.cc:260] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91573c9a14ea4316aec65b438ca2dfd7" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43859 } } peers { permanent_uuid: "db97f880a16a496787096fa95199ccb0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 35063 } } peers { permanent_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45173 } }
I20260812 07:02:19.470031 18890 heartbeater.cc:503] Master 127.18.70.190:41289 was elected leader, sending a full tablet report...
I20260812 07:02:19.470643 18924 ts_tablet_manager.cc:1428] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260812 07:02:19.470377 18922 raft_consensus.cc:348] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91573c9a14ea4316aec65b438ca2dfd7" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43859 } } peers { permanent_uuid: "db97f880a16a496787096fa95199ccb0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 35063 } } peers { permanent_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45173 } }
I20260812 07:02:19.470829 18922 raft_consensus.cc:374] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:19.470920 18922 raft_consensus.cc:729] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db97f880a16a496787096fa95199ccb0, State: Initialized, Role: FOLLOWER
I20260812 07:02:19.471467 18922 consensus_queue.cc:260] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91573c9a14ea4316aec65b438ca2dfd7" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43859 } } peers { permanent_uuid: "db97f880a16a496787096fa95199ccb0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 35063 } } peers { permanent_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45173 } }
I20260812 07:02:19.477866 18925 raft_consensus.cc:348] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91573c9a14ea4316aec65b438ca2dfd7" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43859 } } peers { permanent_uuid: "db97f880a16a496787096fa95199ccb0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 35063 } } peers { permanent_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45173 } }
I20260812 07:02:19.478312 18925 raft_consensus.cc:374] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:19.478641 18619 heartbeater.cc:503] Master 127.18.70.190:41289 was elected leader, sending a full tablet report...
I20260812 07:02:19.479238 18922 ts_tablet_manager.cc:1428] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: Time spent starting tablet: real 0.019s user 0.013s sys 0.003s
I20260812 07:02:19.478420 18925 raft_consensus.cc:729] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91573c9a14ea4316aec65b438ca2dfd7, State: Initialized, Role: FOLLOWER
I20260812 07:02:19.480053 18925 consensus_queue.cc:260] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91573c9a14ea4316aec65b438ca2dfd7" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43859 } } peers { permanent_uuid: "db97f880a16a496787096fa95199ccb0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 35063 } } peers { permanent_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45173 } }
I20260812 07:02:19.481678 18925 ts_tablet_manager.cc:1428] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7: Time spent starting tablet: real 0.014s user 0.009s sys 0.005s
W20260812 07:02:19.577947 18386 tablet.cc:2369] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:02:19.579394 18621 tablet.cc:2369] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:02:19.602494 18891 tablet.cc:2369] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:02:19.612552 18938 raft_consensus.cc:482] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:02:19.612818 18938 raft_consensus.cc:504] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91573c9a14ea4316aec65b438ca2dfd7" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43859 } } peers { permanent_uuid: "db97f880a16a496787096fa95199ccb0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 35063 } } peers { permanent_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45173 } }
I20260812 07:02:19.614486 18938 leader_election.cc:288] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db97f880a16a496787096fa95199ccb0 (127.18.70.130:35063), 2c3df79f7fe64e73a29b591fe85c6a9b (127.18.70.131:45173)
I20260812 07:02:19.620716 18918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.614801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:59971 (local address 127.18.70.130:35063)
0812 07:02:19.615008 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:19.615015 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:19.615553 (+ 538us) server_negotiation.cc:407] Connection header received
0812 07:02:19.615769 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:19.615773 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:19.615850 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:19.615937 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:19.616556 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.617272 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.619057 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.619845 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.619984 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.620073 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:19.620350 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 07:02:19.620473 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 07:02:19.620805 18943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.614828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:35063 (local address 127.18.70.129:59971)
0812 07:02:19.615448 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:19.615465 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:19.615622 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:19.616051 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:19.616060 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:19.616090 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:19.616417 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.616426 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.617409 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.617413 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.618895 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.618908 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.620051 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.620057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.620191 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.620214 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 07:02:19.620308 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 07:02:19.620432 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":338,"threads_started":1}
I20260812 07:02:19.621263 18921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.615742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:46267 (local address 127.18.70.131:45173)
0812 07:02:19.615951 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:19.615957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:19.616401 (+ 444us) server_negotiation.cc:407] Connection header received
0812 07:02:19.616571 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:19.616575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:19.616631 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:19.616701 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:19.617222 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.617943 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.619578 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.620346 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.620497 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.620565 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:19.620907 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 07:02:19.621029 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 07:02:19.621791 18946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.615592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:45173 (local address 127.18.70.129:46267)
0812 07:02:19.616292 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:19.616311 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:19.616448 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:19.616725 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:19.616729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:19.616753 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:19.617076 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.617086 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.618067 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.618071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.619419 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:19.619432 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.620593 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.620600 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:19.620713 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.620735 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 07:02:19.621425 (+ 690us) client_negotiation.cc:240] Negotiation successful
0812 07:02:19.621558 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":371,"threads_started":1}
I20260812 07:02:19.621766 18539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0d6c89f56934f86bdb5c2d0465ca62e" candidate_uuid: "91573c9a14ea4316aec65b438ca2dfd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db97f880a16a496787096fa95199ccb0" is_pre_election: true
I20260812 07:02:19.622318 18539 raft_consensus.cc:2454] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91573c9a14ea4316aec65b438ca2dfd7 in term 0.
I20260812 07:02:19.622716 18797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0d6c89f56934f86bdb5c2d0465ca62e" candidate_uuid: "91573c9a14ea4316aec65b438ca2dfd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" is_pre_election: true
I20260812 07:02:19.622964 18153 leader_election.cc:302] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91573c9a14ea4316aec65b438ca2dfd7, db97f880a16a496787096fa95199ccb0; no voters:
I20260812 07:02:19.623252 18797 raft_consensus.cc:2454] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91573c9a14ea4316aec65b438ca2dfd7 in term 0.
I20260812 07:02:19.623368 18938 raft_consensus.cc:2781] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:02:19.623515 18938 raft_consensus.cc:482] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:02:19.623620 18938 raft_consensus.cc:3037] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:19.625752 18938 raft_consensus.cc:504] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91573c9a14ea4316aec65b438ca2dfd7" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43859 } } peers { permanent_uuid: "db97f880a16a496787096fa95199ccb0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 35063 } } peers { permanent_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45173 } }
I20260812 07:02:19.626312 18938 leader_election.cc:288] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [CANDIDATE]: Term 1 election: Requested vote from peers db97f880a16a496787096fa95199ccb0 (127.18.70.130:35063), 2c3df79f7fe64e73a29b591fe85c6a9b (127.18.70.131:45173)
I20260812 07:02:19.626737 18539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0d6c89f56934f86bdb5c2d0465ca62e" candidate_uuid: "91573c9a14ea4316aec65b438ca2dfd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db97f880a16a496787096fa95199ccb0"
I20260812 07:02:19.626801 18797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0d6c89f56934f86bdb5c2d0465ca62e" candidate_uuid: "91573c9a14ea4316aec65b438ca2dfd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b"
I20260812 07:02:19.626919 18539 raft_consensus.cc:3037] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:19.626974 18797 raft_consensus.cc:3037] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:19.629025 18539 raft_consensus.cc:2454] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91573c9a14ea4316aec65b438ca2dfd7 in term 1.
I20260812 07:02:19.629076 18797 raft_consensus.cc:2454] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91573c9a14ea4316aec65b438ca2dfd7 in term 1.
I20260812 07:02:19.629379 18153 leader_election.cc:302] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91573c9a14ea4316aec65b438ca2dfd7, db97f880a16a496787096fa95199ccb0; no voters:
I20260812 07:02:19.629633 18938 raft_consensus.cc:2781] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:19.630055 18938 raft_consensus.cc:686] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 1 LEADER]: Becoming Leader. State: Replica: 91573c9a14ea4316aec65b438ca2dfd7, State: Running, Role: LEADER
I20260812 07:02:19.630553 18938 consensus_queue.cc:237] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91573c9a14ea4316aec65b438ca2dfd7" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43859 } } peers { permanent_uuid: "db97f880a16a496787096fa95199ccb0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 35063 } } peers { permanent_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45173 } }
I20260812 07:02:19.635001 17990 catalog_manager.cc:5495] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91573c9a14ea4316aec65b438ca2dfd7 (127.18.70.129). New cstate: current_term: 1 leader_uuid: "91573c9a14ea4316aec65b438ca2dfd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91573c9a14ea4316aec65b438ca2dfd7" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db97f880a16a496787096fa95199ccb0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45173 } health_report { overall_health: UNKNOWN } } }
I20260812 07:02:19.666031 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.661245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58160 (local address 127.18.70.129:43859)
0812 07:02:19.661411 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:19.661416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:19.661463 (+ 47us) server_negotiation.cc:407] Connection header received
0812 07:02:19.661628 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:19.661631 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:19.661703 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:19.661817 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:02:19.662164 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.662880 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.664184 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.664568 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.664651 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.665089 (+ 438us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:02:19.665574 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:02:19.665680 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:19.665737 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 07:02:19.665799 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 07:02:19.673519 18797 raft_consensus.cc:1261] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b [term 1 FOLLOWER]: Refusing update from remote peer 91573c9a14ea4316aec65b438ca2dfd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:19.673571 18539 raft_consensus.cc:1261] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0 [term 1 FOLLOWER]: Refusing update from remote peer 91573c9a14ea4316aec65b438ca2dfd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:19.674388 18948 consensus_queue.cc:1035] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db97f880a16a496787096fa95199ccb0" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:19.674724 18938 consensus_queue.cc:1035] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3df79f7fe64e73a29b591fe85c6a9b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 45173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:19.688285 18953 mvcc.cc:205] Tried to move back new op lower bound from 7317578300094078976 to 7317578299929985024. Current Snapshot: MvccSnapshot[applied={T|T < 7317578300094078976}]
I20260812 07:02:19.701988 17989 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:19.702243 17989 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:19.706068 17989 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dccfbfffb1554a01999cffc6a32577fe: Sending DeleteTablet for 3 replicas of tablet d0d6c89f56934f86bdb5c2d0465ca62e
I20260812 07:02:19.707196 18259 tablet_service.cc:1514] Processing DeleteTablet for tablet d0d6c89f56934f86bdb5c2d0465ca62e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:19 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:58154
I20260812 07:02:19.707505 18500 tablet_service.cc:1514] Processing DeleteTablet for tablet d0d6c89f56934f86bdb5c2d0465ca62e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:19 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:49770
I20260812 07:02:19.708146 18752 tablet_service.cc:1514] Processing DeleteTablet for tablet d0d6c89f56934f86bdb5c2d0465ca62e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:19 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:45814
I20260812 07:02:19.708551 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 18122
I20260812 07:02:19.730437 18978 tablet_replica.cc:330] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: stopping tablet replica
I20260812 07:02:19.730748 18977 tablet_replica.cc:330] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: stopping tablet replica
I20260812 07:02:19.730993 18978 raft_consensus.cc:2229] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:02:19.731134 18977 raft_consensus.cc:2229] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0 [term 1 FOLLOWER]: Raft consensus shutting down.
Aug 12 07:02:19 dist-test-slave-tc2s krb5kdc[17908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 07:02:19.731576 18978 raft_consensus.cc:2258] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:19.731801 18977 raft_consensus.cc:2258] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:19.732654 18976 tablet_replica.cc:330] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7: stopping tablet replica
I20260812 07:02:19.733094 18976 raft_consensus.cc:2229] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 07:02:19.733837 18976 raft_consensus.cc:2258] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:19.734117 18978 ts_tablet_manager.cc:1905] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:19.735816 18977 ts_tablet_manager.cc:1905] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:19.741370 18976 ts_tablet_manager.cc:1905] T d0d6c89f56934f86bdb5c2d0465ca62e P 91573c9a14ea4316aec65b438ca2dfd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:19.743222 18977 ts_tablet_manager.cc:1918] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:19.743409 18977 log.cc:1196] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/d0d6c89f56934f86bdb5c2d0465ca62e
I20260812 07:02:19.743955 18977 ts_tablet_manager.cc:1939] T d0d6c89f56934f86bdb5c2d0465ca62e P db97f880a16a496787096fa95199ccb0: Deleting consensus metadata
I20260812 07:02:19.745873 17961 catalog_manager.cc:4841] TS db97f880a16a496787096fa95199ccb0 (127.18.70.130:35063): tablet d0d6c89f56934f86bdb5c2d0465ca62e (table test-table [id=885261721b4b4990a659adf70bf2a99c]) successfully deleted
I20260812 07:02:19.748845 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.714488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58174 (local address 127.18.70.129:43859)
0812 07:02:19.714670 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:19.714677 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:19.715714 (+ 1037us) server_negotiation.cc:407] Connection header received
0812 07:02:19.716598 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:19.716604 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:19.716711 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:19.716787 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:19.720408 (+ 3621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.721659 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.725445 (+ 3786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.726211 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.726313 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.733811 (+ 7498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:19.733830 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:19.733850 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:19.733923 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:19.744570 (+ 10647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:19.745486 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:19.745495 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:19.745499 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:19.745694 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:19.746220 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:19.746225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:19.746228 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:19.746698 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:19.748025 (+ 1327us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:19.748184 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 07:02:19.748479 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 07:02:19.749512 18370 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:19.749883 18978 ts_tablet_manager.cc:1918] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:19.750102 18978 log.cc:1196] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/d0d6c89f56934f86bdb5c2d0465ca62e
I20260812 07:02:19.750634 18978 ts_tablet_manager.cc:1939] T d0d6c89f56934f86bdb5c2d0465ca62e P 2c3df79f7fe64e73a29b591fe85c6a9b: Deleting consensus metadata
I20260812 07:02:19.752388 17961 catalog_manager.cc:4841] TS 2c3df79f7fe64e73a29b591fe85c6a9b (127.18.70.131:45173): tablet d0d6c89f56934f86bdb5c2d0465ca62e (table test-table [id=885261721b4b4990a659adf70bf2a99c]) successfully deleted
I20260812 07:02:19.857173 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 18122
I20260812 07:02:19.880026 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 18394
W20260812 07:02:19.879983 17964 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.70.129:43859 (error 108)
I20260812 07:02:19.881983 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.881483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43859 (local address 127.0.0.1:58180)
0812 07:02:19.881641 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:19.881765 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 07:02:19.882339 17964 catalog_manager.cc:4584] TS 91573c9a14ea4316aec65b438ca2dfd7 (127.18.70.129:43859): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d0d6c89f56934f86bdb5c2d0465ca62e: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43859: connect: Connection refused (error 111)
Aug 12 07:02:19 dist-test-slave-tc2s krb5kdc[17908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 07:02:19.899997 18918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.880909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49780 (local address 127.18.70.130:35063)
0812 07:02:19.881082 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:19.881087 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:19.881162 (+ 75us) server_negotiation.cc:407] Connection header received
0812 07:02:19.881396 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:19.881401 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:19.881499 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:19.881610 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:19.883171 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.883951 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.885278 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:19.885743 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:19.885865 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:19.891333 (+ 5468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:19.891349 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:19.891378 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:19.891424 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:19.896442 (+ 5018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:19.897097 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:19.897105 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:19.897107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:19.897237 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:19.897589 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:19.897594 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:19.897598 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:19.898102 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:19.898408 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:19.899526 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0812 07:02:19.899721 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 07:02:19.900645 18613 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:19.935783 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.935335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43859 (local address 127.0.0.1:58196)
0812 07:02:19.935519 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:19.935616 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 07:02:19.936805 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.936428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43859 (local address 127.0.0.1:58204)
0812 07:02:19.936567 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:19.936651 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 07:02:19.997362 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.996902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43859 (local address 127.0.0.1:58216)
0812 07:02:19.997106 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:19.997195 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 07:02:19.998333 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:19.998027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43859 (local address 127.0.0.1:58228)
0812 07:02:19.998142 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:19.998211 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 07:02:20.004077 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 18394
I20260812 07:02:20.027392 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 18628
Aug 12 07:02:20 dist-test-slave-tc2s krb5kdc[17908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 07:02:20.041867 18921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:20.028121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45820 (local address 127.18.70.131:45173)
0812 07:02:20.028333 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:20.028339 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:20.028360 (+ 21us) server_negotiation.cc:407] Connection header received
0812 07:02:20.028494 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:20.028498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:20.028562 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:20.028643 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:20.030003 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:20.030762 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:20.032030 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:20.032436 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:20.032527 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:20.036763 (+ 4236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:20.036779 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:20.036797 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:20.036840 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:20.039502 (+ 2662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:20.040142 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:20.040149 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:20.040151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:20.040327 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:20.040603 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:20.040606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:20.040608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:20.040947 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:20.041160 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:20.041396 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 07:02:20.041550 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 07:02:20.042464 18878 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:20.079355 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:20.078916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43859 (local address 127.0.0.1:58242)
0812 07:02:20.079110 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:20.079196 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 07:02:20.080394 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:20.079970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43859 (local address 127.0.0.1:58244)
0812 07:02:20.080161 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:20.080250 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260812 07:02:20.127959 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 18628
I20260812 07:02:20.153209 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 17930
I20260812 07:02:20.154345 18049 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:20.263182 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 17930
I20260812 07:02:20.263238 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:20.262690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43859 (local address 127.0.0.1:58248)
0812 07:02:20.262901 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:20.263013 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
2026-08-12T07:02:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4558 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T07:02:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:20Z Disabled control of system clock
I20260812 07:02:20.349879 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:35861
--webserver_interface=127.18.70.190
--webserver_port=0
--builtin_ntp_servers=127.18.70.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:35861
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 07:02:20.673578 18995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:20.673840 18995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:20.673972 18995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:20.680953 18995 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:20.681041 18995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:20.681102 18995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:20.681180 18995 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:20.681237 18995 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:20.689998 18995 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:35861
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:35861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:20.691114 18995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:20.692821 18995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:20.703689 19003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:20.703722 19004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:20.703742 19010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:20.704674 18995 server_base.cc:1034] running on GCE node
I20260812 07:02:20.705411 18995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:20.706754 18995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:20.707958 18995 hybrid_clock.cc:648] HybridClock initialized: now 1786518140707907 us; error 42 us; skew 500 ppm
I20260812 07:02:20.708272 18995 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:20.713032 18995 webserver.cc:460] Webserver started at http://127.18.70.190:34105/ using document root <none> and password file <none>
I20260812 07:02:20.713709 18995 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:20.713821 18995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:20.714154 18995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:20.716904 18995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "9835ab0a89c9463caa8ac67ccb33c0fb"
format_stamp: "Formatted at 2026-08-12 07:02:20 on dist-test-slave-tc2s"
server_key: "45383ffba0c479a30002efa8fdfc7f70"
server_key_iv: "427b8147d0865f520b26b301ed26b20e"
server_key_version: "encryptionkey@0"
I20260812 07:02:20.717693 18995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "9835ab0a89c9463caa8ac67ccb33c0fb"
format_stamp: "Formatted at 2026-08-12 07:02:20 on dist-test-slave-tc2s"
server_key: "45383ffba0c479a30002efa8fdfc7f70"
server_key_iv: "427b8147d0865f520b26b301ed26b20e"
server_key_version: "encryptionkey@0"
I20260812 07:02:20.722491 18995 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 07:02:20.725703 19022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:20.726936 18995 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 07:02:20.727099 18995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "9835ab0a89c9463caa8ac67ccb33c0fb"
format_stamp: "Formatted at 2026-08-12 07:02:20 on dist-test-slave-tc2s"
server_key: "45383ffba0c479a30002efa8fdfc7f70"
server_key_iv: "427b8147d0865f520b26b301ed26b20e"
server_key_version: "encryptionkey@0"
I20260812 07:02:20.727290 18995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:20.746658 18995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:20.747362 18995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:20.747612 18995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:20.764635 18995 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:35861
I20260812 07:02:20.764693 19114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:35861 every 8 connection(s)
I20260812 07:02:20.765829 18995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:20.769345 19115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:20.769806 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 18995
I20260812 07:02:20.770004 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:20.770435 18714 external_mini_cluster.cc:1428] Setting key 6f1215d18aee53892a28c582d7d6555a
I20260812 07:02:20.780963 19115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb: Bootstrap starting.
I20260812 07:02:20.783324 19121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:20.772213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55276 (local address 127.18.70.190:35861)
0812 07:02:20.773157 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:20.773170 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:20.773208 (+ 38us) server_negotiation.cc:407] Connection header received
0812 07:02:20.775210 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:20.775231 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:20.775648 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:20.775986 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:20.776545 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:20.777793 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:20.779282 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:20.779918 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:20.780085 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:20.781217 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:20.781225 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:20.781237 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:20.781740 (+ 503us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:20.781818 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:20.781840 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:20.781967 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:20.782187 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 07:02:20.782480 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":357,"threads_started":1}
I20260812 07:02:20.784307 19115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:20.785391 19115 log.cc:824] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:20.787948 19115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb: No bootstrap required, opened a new log
I20260812 07:02:20.795154 19115 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9835ab0a89c9463caa8ac67ccb33c0fb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35861 } }
I20260812 07:02:20.795476 19115 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:20.795568 19115 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9835ab0a89c9463caa8ac67ccb33c0fb, State: Initialized, Role: FOLLOWER
I20260812 07:02:20.796087 19115 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9835ab0a89c9463caa8ac67ccb33c0fb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35861 } }
I20260812 07:02:20.796305 19115 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:20.796448 19115 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:20.796595 19115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:20.798853 19115 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9835ab0a89c9463caa8ac67ccb33c0fb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35861 } }
I20260812 07:02:20.799271 19115 leader_election.cc:302] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9835ab0a89c9463caa8ac67ccb33c0fb; no voters:
I20260812 07:02:20.799765 19115 leader_election.cc:288] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:20.799904 19125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:20.800596 19125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [term 1 LEADER]: Becoming Leader. State: Replica: 9835ab0a89c9463caa8ac67ccb33c0fb, State: Running, Role: LEADER
I20260812 07:02:20.801064 19125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9835ab0a89c9463caa8ac67ccb33c0fb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35861 } }
I20260812 07:02:20.801610 19115 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:20.803694 19126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9835ab0a89c9463caa8ac67ccb33c0fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9835ab0a89c9463caa8ac67ccb33c0fb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35861 } } }
I20260812 07:02:20.804105 19126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:20.804543 19127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9835ab0a89c9463caa8ac67ccb33c0fb. Latest consensus state: current_term: 1 leader_uuid: "9835ab0a89c9463caa8ac67ccb33c0fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9835ab0a89c9463caa8ac67ccb33c0fb" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35861 } } }
I20260812 07:02:20.804833 19127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:20.806005 19136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:20.810226 19136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:20.817749 19136 catalog_manager.cc:1347] Generated new cluster ID: 5460a0666471410ba2ff73cc409ae398
I20260812 07:02:20.817854 19136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:20.834787 19136 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:20.835954 19136 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:20.842751 19136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb: Generated new TSK 0
I20260812 07:02:20.843632 19136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:20.858294 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35861
--builtin_ntp_servers=127.18.70.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 07:02:21.182729 19160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:21.182989 19160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:21.183112 19160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:21.190093 19160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:21.190188 19160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:21.190327 19160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:02:21.199062 19160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:21.200215 19160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:21.201968 19160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:21.214509 19172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:21.214520 19175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:21.214979 19171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:21.215441 19160 server_base.cc:1034] running on GCE node
I20260812 07:02:21.215994 19160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:21.216849 19160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:21.218052 19160 hybrid_clock.cc:648] HybridClock initialized: now 1786518141217997 us; error 39 us; skew 500 ppm
I20260812 07:02:21.218341 19160 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:21.220398 19160 webserver.cc:460] Webserver started at http://127.18.70.129:32815/ using document root <none> and password file <none>
I20260812 07:02:21.221036 19160 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:21.221136 19160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:21.221428 19160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:21.224139 19160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b"
format_stamp: "Formatted at 2026-08-12 07:02:21 on dist-test-slave-tc2s"
server_key: "aacf384ba5fcc226efb1c0bdf07b739c"
server_key_iv: "2bb0310e5002571d92020a9f12a71060"
server_key_version: "encryptionkey@0"
I20260812 07:02:21.224913 19160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b"
format_stamp: "Formatted at 2026-08-12 07:02:21 on dist-test-slave-tc2s"
server_key: "aacf384ba5fcc226efb1c0bdf07b739c"
server_key_iv: "2bb0310e5002571d92020a9f12a71060"
server_key_version: "encryptionkey@0"
I20260812 07:02:21.229609 19160 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 07:02:21.232966 19183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:21.234150 19160 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.003s
I20260812 07:02:21.234287 19160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b"
format_stamp: "Formatted at 2026-08-12 07:02:21 on dist-test-slave-tc2s"
server_key: "aacf384ba5fcc226efb1c0bdf07b739c"
server_key_iv: "2bb0310e5002571d92020a9f12a71060"
server_key_version: "encryptionkey@0"
I20260812 07:02:21.234475 19160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:21.244117 19160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:21.244783 19160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:21.245047 19160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:21.245925 19160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:21.247225 19160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:21.247318 19160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:21.247419 19160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:21.247486 19160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:21.277223 19160 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:44063
I20260812 07:02:21.277263 19396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:44063 every 8 connection(s)
I20260812 07:02:21.278553 19160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:02:21.285017 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 19160
I20260812 07:02:21.285200 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 07:02:21.285825 18714 external_mini_cluster.cc:1428] Setting key 80e512618fd6e80cc59bea97da5159b6
I20260812 07:02:21.288939 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35861
--builtin_ntp_servers=127.18.70.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 07:02:21.294705 19121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:21.281513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:49127 (local address 127.18.70.190:35861)
0812 07:02:21.281736 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:21.281742 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:21.285952 (+ 4210us) server_negotiation.cc:407] Connection header received
0812 07:02:21.287894 (+ 1942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:21.287898 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:21.287965 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:21.288044 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:21.289369 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:21.290122 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:21.292174 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:21.292576 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:21.292660 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:21.294057 (+ 1397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:21.294062 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:21.294065 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:21.294082 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:21.294113 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:21.294125 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:21.294191 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:21.294394 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 07:02:21.294480 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 07:02:21.295888 19402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:21.282025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:35861 (local address 127.18.70.129:49127)
0812 07:02:21.285729 (+ 3704us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:21.285784 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:21.287637 (+ 1853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:21.288296 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:21.288307 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:21.288423 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:21.289206 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:21.289231 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:21.290297 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:21.290303 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:21.292054 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:21.292070 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:21.292783 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:21.292789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:21.293049 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:21.293709 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 07:02:21.293712 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:21.293756 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 07:02:21.293856 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:21.294211 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:21.294220 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:21.294228 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 07:02:21.294392 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 07:02:21.294724 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3168,"thread_start_us":2975,"threads_started":1}
I20260812 07:02:21.297245 19399 heartbeater.cc:347] Connected to a master server at 127.18.70.190:35861
I20260812 07:02:21.297516 19399 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:21.298225 19399 heartbeater.cc:511] Master 127.18.70.190:35861 requested a full tablet report, sending...
I20260812 07:02:21.300217 19048 ts_manager.cc:194] Registered new tserver with Master: 7967b5e53ea64ee6b9aa9bd804f01a9b (127.18.70.129:44063)
I20260812 07:02:21.301782 19048 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.129:49127
W20260812 07:02:21.619419 19403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:21.619663 19403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:21.619788 19403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:21.626784 19403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:21.626868 19403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:21.626998 19403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:02:21.635706 19403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:21.636775 19403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:21.638525 19403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:21.650954 19414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:21.651037 19422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:21.651062 19415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:21.651973 19403 server_base.cc:1034] running on GCE node
I20260812 07:02:21.652529 19403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:21.653380 19403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:21.654575 19403 hybrid_clock.cc:648] HybridClock initialized: now 1786518141654531 us; error 39 us; skew 500 ppm
I20260812 07:02:21.654870 19403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:21.656929 19403 webserver.cc:460] Webserver started at http://127.18.70.130:39667/ using document root <none> and password file <none>
I20260812 07:02:21.657567 19403 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:21.657665 19403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:21.658008 19403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:21.660764 19403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "cf35d1f36cf04b2680ddccff50cecf83"
format_stamp: "Formatted at 2026-08-12 07:02:21 on dist-test-slave-tc2s"
server_key: "180bfce9d86ad9e999b14ed039f77555"
server_key_iv: "d705bedaf01064b66b81ffddc7ec7b6e"
server_key_version: "encryptionkey@0"
I20260812 07:02:21.661521 19403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "cf35d1f36cf04b2680ddccff50cecf83"
format_stamp: "Formatted at 2026-08-12 07:02:21 on dist-test-slave-tc2s"
server_key: "180bfce9d86ad9e999b14ed039f77555"
server_key_iv: "d705bedaf01064b66b81ffddc7ec7b6e"
server_key_version: "encryptionkey@0"
I20260812 07:02:21.666232 19403 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260812 07:02:21.669409 19437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:21.670607 19403 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 07:02:21.670751 19403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "cf35d1f36cf04b2680ddccff50cecf83"
format_stamp: "Formatted at 2026-08-12 07:02:21 on dist-test-slave-tc2s"
server_key: "180bfce9d86ad9e999b14ed039f77555"
server_key_iv: "d705bedaf01064b66b81ffddc7ec7b6e"
server_key_version: "encryptionkey@0"
I20260812 07:02:21.670936 19403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:21.683434 19403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:21.684123 19403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:21.684387 19403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:21.685254 19403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:21.686589 19403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:21.686681 19403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:21.686789 19403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:21.686857 19403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:21.716748 19403 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:37949
I20260812 07:02:21.716790 19659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:37949 every 8 connection(s)
I20260812 07:02:21.717950 19403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:02:21.727444 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 19403
I20260812 07:02:21.727650 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 07:02:21.728245 18714 external_mini_cluster.cc:1428] Setting key 3221d6c3f240f3c3b39b64fa13dd5f7f
I20260812 07:02:21.729658 19121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:21.720261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:46659 (local address 127.18.70.190:35861)
0812 07:02:21.720437 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:21.720442 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:21.721655 (+ 1213us) server_negotiation.cc:407] Connection header received
0812 07:02:21.723392 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:21.723397 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:21.723468 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:21.723546 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:21.724494 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:21.725230 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:21.726843 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:21.727250 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:21.727350 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:21.728852 (+ 1502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:21.728857 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:21.728861 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:21.728878 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:21.728909 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:21.728921 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:21.728998 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:21.729211 (+ 213us) server_negotiation.cc:299] Negotiation successful
0812 07:02:21.729315 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 07:02:21.730582 19665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:21.720687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:35861 (local address 127.18.70.130:46659)
0812 07:02:21.721507 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:21.721552 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:21.723131 (+ 1579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:21.723729 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:21.723736 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:21.723825 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:21.724347 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:21.724364 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:21.725366 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:21.725370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:21.726714 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:21.726728 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:21.727500 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:21.727509 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:21.727843 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:21.728557 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 07:02:21.728560 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:21.728595 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 07:02:21.728664 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:21.729017 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:21.729028 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:21.729034 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 07:02:21.729176 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 07:02:21.729517 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":259,"threads_started":1}
I20260812 07:02:21.730983 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35861
--builtin_ntp_servers=127.18.70.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 07:02:21.731824 19661 heartbeater.cc:347] Connected to a master server at 127.18.70.190:35861
I20260812 07:02:21.732120 19661 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:21.732978 19661 heartbeater.cc:511] Master 127.18.70.190:35861 requested a full tablet report, sending...
I20260812 07:02:21.734396 19048 ts_manager.cc:194] Registered new tserver with Master: cf35d1f36cf04b2680ddccff50cecf83 (127.18.70.130:37949)
I20260812 07:02:21.735170 19048 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.130:46659
W20260812 07:02:22.059168 19666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:22.059422 19666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:22.059517 19666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:22.066496 19666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:22.066581 19666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:22.066686 19666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:02:22.075770 19666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:22.076849 19666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:22.078492 19666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:22.090687 19681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:22.090730 19679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:22.090646 19677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:22.091419 19666 server_base.cc:1034] running on GCE node
I20260812 07:02:22.091979 19666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:22.092819 19666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:22.093981 19666 hybrid_clock.cc:648] HybridClock initialized: now 1786518142093920 us; error 47 us; skew 500 ppm
I20260812 07:02:22.094271 19666 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:22.096335 19666 webserver.cc:460] Webserver started at http://127.18.70.131:38865/ using document root <none> and password file <none>
I20260812 07:02:22.096947 19666 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:22.097054 19666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:22.097344 19666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:22.100036 19666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "ea39fbf3b5ae40ed96daf1f323c303ae"
format_stamp: "Formatted at 2026-08-12 07:02:22 on dist-test-slave-tc2s"
server_key: "ca378507deea44cc9a6d2e961b561d2e"
server_key_iv: "c967ebe255569009257c626996a3b296"
server_key_version: "encryptionkey@0"
I20260812 07:02:22.100782 19666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "ea39fbf3b5ae40ed96daf1f323c303ae"
format_stamp: "Formatted at 2026-08-12 07:02:22 on dist-test-slave-tc2s"
server_key: "ca378507deea44cc9a6d2e961b561d2e"
server_key_iv: "c967ebe255569009257c626996a3b296"
server_key_version: "encryptionkey@0"
I20260812 07:02:22.105592 19666 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 07:02:22.108711 19694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:22.109858 19666 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 07:02:22.110051 19666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "ea39fbf3b5ae40ed96daf1f323c303ae"
format_stamp: "Formatted at 2026-08-12 07:02:22 on dist-test-slave-tc2s"
server_key: "ca378507deea44cc9a6d2e961b561d2e"
server_key_iv: "c967ebe255569009257c626996a3b296"
server_key_version: "encryptionkey@0"
I20260812 07:02:22.110235 19666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:22.147408 19666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:22.148172 19666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:22.148440 19666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:22.149319 19666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:22.150699 19666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:22.150794 19666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:22.150897 19666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:22.150978 19666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:22.180778 19666 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:39633
I20260812 07:02:22.180848 19897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:39633 every 8 connection(s)
I20260812 07:02:22.182029 19666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:02:22.188789 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 19666
I20260812 07:02:22.188961 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 07:02:22.189416 18714 external_mini_cluster.cc:1428] Setting key e01daf2df4c06ee6b04704bc317c3704
I20260812 07:02:22.193810 19121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.184367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:56887 (local address 127.18.70.190:35861)
0812 07:02:22.184541 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:22.184545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:22.185814 (+ 1269us) server_negotiation.cc:407] Connection header received
0812 07:02:22.187533 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:22.187537 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:22.187604 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:22.187689 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:22.188731 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.189484 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.191249 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.191675 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.191789 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.193030 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:22.193036 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:22.193039 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:22.193055 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:22.193088 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:22.193100 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:22.193173 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:22.193382 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 07:02:22.193487 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 07:02:22.194715 19901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.184836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:35861 (local address 127.18.70.131:56887)
0812 07:02:22.185682 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.185717 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:22.187298 (+ 1581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:22.187857 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:22.187864 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:22.187948 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:22.188560 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.188589 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.189671 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.189676 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.191104 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.191117 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.191899 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.191908 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.192164 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.192737 (+ 573us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 07:02:22.192739 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:22.192774 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 07:02:22.192846 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:22.193191 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:22.193203 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:22.193209 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 07:02:22.193354 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 07:02:22.193734 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":250,"threads_started":1}
I20260812 07:02:22.195814 19898 heartbeater.cc:347] Connected to a master server at 127.18.70.190:35861
I20260812 07:02:22.196054 19898 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:22.196707 19898 heartbeater.cc:511] Master 127.18.70.190:35861 requested a full tablet report, sending...
I20260812 07:02:22.197999 19048 ts_manager.cc:194] Registered new tserver with Master: ea39fbf3b5ae40ed96daf1f323c303ae (127.18.70.131:39633)
I20260812 07:02:22.198786 19048 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.131:56887
I20260812 07:02:22.204056 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 07:02:22.213977 19121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.208139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55290 (local address 127.18.70.190:35861)
0812 07:02:22.208361 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:22.208368 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:22.208676 (+ 308us) server_negotiation.cc:407] Connection header received
0812 07:02:22.208827 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:22.208832 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:22.208893 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:22.208971 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:22.209473 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.210258 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.211673 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.212074 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.212162 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.213204 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:22.213209 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:22.213212 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:22.213228 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:22.213257 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:22.213269 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:22.213373 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:22.213506 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 07:02:22.213605 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 07:02:22.217561 19048 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 07:02:22.224349 19048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 07:02:22.247475 19925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.235732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:37949 (local address 127.0.0.1:53740)
0812 07:02:22.236674 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.236731 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:22.236936 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:22.239882 (+ 2946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:22.239891 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:22.239926 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:22.240483 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.240499 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.242277 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.242282 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.244755 (+ 2473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.244777 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.246592 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.246598 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.246785 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.246852 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 07:02:22.246980 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 07:02:22.247145 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":4614,"threads_started":1}
I20260812 07:02:22.247732 19927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.236165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53740 (local address 127.18.70.130:37949)
0812 07:02:22.239226 (+ 3061us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:22.239235 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:22.239269 (+ 34us) server_negotiation.cc:407] Connection header received
0812 07:02:22.239395 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:22.239404 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:22.239641 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:22.239952 (+ 311us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:22.240684 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.242154 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.245021 (+ 2867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.246411 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.246547 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.246775 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:22.247053 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 07:02:22.247224 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2911,"thread_start_us":2802,"threads_started":1}
I20260812 07:02:22.248240 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.235986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:39633 (local address 127.0.0.1:41124)
0812 07:02:22.237648 (+ 1662us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.237666 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:22.237776 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:22.241391 (+ 3615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:22.241396 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:22.241423 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:22.241959 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.241976 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.243432 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.243437 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.245411 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.245427 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.247477 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.247483 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.247637 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.247667 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 07:02:22.247752 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 07:02:22.247888 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1524,"mutex_wait_us":26,"thread_start_us":2395,"threads_started":1}
I20260812 07:02:22.248764 19924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.237047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44063 (local address 127.0.0.1:41040)
0812 07:02:22.240860 (+ 3813us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.240883 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:22.240995 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:22.241863 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:22.241866 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:22.241888 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:22.242280 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.242292 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.244142 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.244148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.246104 (+ 1956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.246120 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.248089 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.248094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.248221 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.248246 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 07:02:22.248316 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 07:02:22.248441 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3702,"mutex_wait_us":1,"thread_start_us":779,"threads_started":1}
I20260812 07:02:22.249018 19933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.237641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41040 (local address 127.18.70.129:44063)
0812 07:02:22.238322 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:22.238332 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:22.241110 (+ 2778us) server_negotiation.cc:407] Connection header received
0812 07:02:22.241209 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:22.241216 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:22.241442 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:22.241617 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:22.242488 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.243998 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.246312 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.247628 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.247754 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.247968 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:22.248455 (+ 487us) server_negotiation.cc:299] Negotiation successful
0812 07:02:22.248618 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":950,"threads_started":1}
I20260812 07:02:22.249855 19930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.236255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41124 (local address 127.18.70.131:39633)
0812 07:02:22.240830 (+ 4575us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:22.240838 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:22.240870 (+ 32us) server_negotiation.cc:407] Connection header received
0812 07:02:22.240965 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:22.240972 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:22.241168 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:22.242005 (+ 837us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:22.242264 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.243295 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.245612 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.246959 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.247087 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.247319 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:22.249342 (+ 2023us) server_negotiation.cc:299] Negotiation successful
0812 07:02:22.249490 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4412,"thread_start_us":4261,"threads_started":1}
I20260812 07:02:22.251257 19539 tablet_service.cc:1467] Processing CreateTablet for tablet 20419b5780c440ee838f7722576c63d6 (DEFAULT_TABLE table=test-table [id=ea7f8343fc354b679e1764467c422dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:22.252494 19539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20419b5780c440ee838f7722576c63d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:22.252432 19783 tablet_service.cc:1467] Processing CreateTablet for tablet 20419b5780c440ee838f7722576c63d6 (DEFAULT_TABLE table=test-table [id=ea7f8343fc354b679e1764467c422dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:22.253818 19783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20419b5780c440ee838f7722576c63d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:22.255808 19267 tablet_service.cc:1467] Processing CreateTablet for tablet 20419b5780c440ee838f7722576c63d6 (DEFAULT_TABLE table=test-table [id=ea7f8343fc354b679e1764467c422dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:22.257037 19267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20419b5780c440ee838f7722576c63d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:22.263720 19934 tablet_bootstrap.cc:492] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83: Bootstrap starting.
I20260812 07:02:22.266793 19934 tablet_bootstrap.cc:654] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:22.267665 19935 tablet_bootstrap.cc:492] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae: Bootstrap starting.
I20260812 07:02:22.268965 19934 log.cc:824] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:22.271008 19935 tablet_bootstrap.cc:654] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:22.272095 19934 tablet_bootstrap.cc:492] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83: No bootstrap required, opened a new log
I20260812 07:02:22.272179 19935 log.cc:824] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:22.272375 19934 ts_tablet_manager.cc:1397] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260812 07:02:22.273036 19939 tablet_bootstrap.cc:492] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b: Bootstrap starting.
I20260812 07:02:22.274677 19935 tablet_bootstrap.cc:492] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae: No bootstrap required, opened a new log
I20260812 07:02:22.274906 19935 ts_tablet_manager.cc:1397] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260812 07:02:22.276465 19939 tablet_bootstrap.cc:654] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:22.277786 19939 log.cc:824] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:22.282230 19939 tablet_bootstrap.cc:492] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b: No bootstrap required, opened a new log
I20260812 07:02:22.282510 19939 ts_tablet_manager.cc:1397] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260812 07:02:22.283048 19934 raft_consensus.cc:348] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf35d1f36cf04b2680ddccff50cecf83" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 37949 } } peers { permanent_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39633 } } peers { permanent_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44063 } }
I20260812 07:02:22.283732 19934 raft_consensus.cc:374] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:22.283882 19934 raft_consensus.cc:729] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf35d1f36cf04b2680ddccff50cecf83, State: Initialized, Role: FOLLOWER
I20260812 07:02:22.286875 19935 raft_consensus.cc:348] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf35d1f36cf04b2680ddccff50cecf83" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 37949 } } peers { permanent_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39633 } } peers { permanent_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44063 } }
I20260812 07:02:22.287395 19935 raft_consensus.cc:374] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:22.287526 19935 raft_consensus.cc:729] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea39fbf3b5ae40ed96daf1f323c303ae, State: Initialized, Role: FOLLOWER
I20260812 07:02:22.288282 19935 consensus_queue.cc:260] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf35d1f36cf04b2680ddccff50cecf83" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 37949 } } peers { permanent_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39633 } } peers { permanent_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44063 } }
I20260812 07:02:22.289391 19898 heartbeater.cc:503] Master 127.18.70.190:35861 was elected leader, sending a full tablet report...
I20260812 07:02:22.290033 19935 ts_tablet_manager.cc:1428] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae: Time spent starting tablet: real 0.015s user 0.009s sys 0.005s
I20260812 07:02:22.284618 19934 consensus_queue.cc:260] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf35d1f36cf04b2680ddccff50cecf83" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 37949 } } peers { permanent_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39633 } } peers { permanent_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44063 } }
I20260812 07:02:22.292924 19939 raft_consensus.cc:348] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf35d1f36cf04b2680ddccff50cecf83" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 37949 } } peers { permanent_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39633 } } peers { permanent_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44063 } }
I20260812 07:02:22.293372 19939 raft_consensus.cc:374] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:22.293514 19939 raft_consensus.cc:729] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7967b5e53ea64ee6b9aa9bd804f01a9b, State: Initialized, Role: FOLLOWER
I20260812 07:02:22.293637 19945 raft_consensus.cc:482] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:02:22.294158 19661 heartbeater.cc:503] Master 127.18.70.190:35861 was elected leader, sending a full tablet report...
I20260812 07:02:22.293955 19945 raft_consensus.cc:504] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf35d1f36cf04b2680ddccff50cecf83" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 37949 } } peers { permanent_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39633 } } peers { permanent_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44063 } }
I20260812 07:02:22.294286 19939 consensus_queue.cc:260] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf35d1f36cf04b2680ddccff50cecf83" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 37949 } } peers { permanent_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39633 } } peers { permanent_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44063 } }
I20260812 07:02:22.295754 19945 leader_election.cc:288] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea39fbf3b5ae40ed96daf1f323c303ae (127.18.70.131:39633), 7967b5e53ea64ee6b9aa9bd804f01a9b (127.18.70.129:44063)
I20260812 07:02:22.297068 19934 ts_tablet_manager.cc:1428] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83: Time spent starting tablet: real 0.025s user 0.016s sys 0.000s
I20260812 07:02:22.298511 19399 heartbeater.cc:503] Master 127.18.70.190:35861 was elected leader, sending a full tablet report...
I20260812 07:02:22.299243 19939 ts_tablet_manager.cc:1428] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b: Time spent starting tablet: real 0.017s user 0.012s sys 0.000s
I20260812 07:02:22.305351 19930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.296731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:39465 (local address 127.18.70.131:39633)
0812 07:02:22.297026 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:22.297032 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:22.298081 (+ 1049us) server_negotiation.cc:407] Connection header received
0812 07:02:22.298204 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:22.298209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:22.298278 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:22.298359 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:22.300326 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.301378 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.303756 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.304545 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.304685 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.304755 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:22.304996 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 07:02:22.305124 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260812 07:02:22.305402 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.296092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:39633 (local address 127.18.70.130:39465)
0812 07:02:22.297929 (+ 1837us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.297948 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:22.298088 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:22.299646 (+ 1558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:22.299651 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:22.299676 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:22.300100 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.300116 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.301729 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.301734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.303575 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.303589 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.304722 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.304729 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.304858 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.304881 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 07:02:22.304960 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 07:02:22.305082 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1666,"thread_start_us":1530,"threads_started":1}
I20260812 07:02:22.306293 19933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.296572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:54817 (local address 127.18.70.129:44063)
0812 07:02:22.296939 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:22.296946 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:22.300786 (+ 3840us) server_negotiation.cc:407] Connection header received
0812 07:02:22.300958 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:22.300964 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:22.301059 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:22.301118 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:22.301871 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.302674 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.304509 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.305308 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.305468 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.305533 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:22.306038 (+ 505us) server_negotiation.cc:299] Negotiation successful
0812 07:02:22.306130 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214}
I20260812 07:02:22.306429 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.296205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44063 (local address 127.18.70.130:54817)
0812 07:02:22.300674 (+ 4469us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.300692 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:22.300812 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:22.301302 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:22.301306 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:22.301330 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:22.301732 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.301744 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.302851 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.302857 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.304341 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:22.304358 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.305659 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.305666 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:22.305859 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.305912 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 07:02:22.306011 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 07:02:22.306130 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4353,"thread_start_us":4212,"threads_started":1}
I20260812 07:02:22.306375 19817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20419b5780c440ee838f7722576c63d6" candidate_uuid: "cf35d1f36cf04b2680ddccff50cecf83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" is_pre_election: true
I20260812 07:02:22.306946 19817 raft_consensus.cc:2454] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf35d1f36cf04b2680ddccff50cecf83 in term 0.
I20260812 07:02:22.307339 19304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20419b5780c440ee838f7722576c63d6" candidate_uuid: "cf35d1f36cf04b2680ddccff50cecf83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" is_pre_election: true
I20260812 07:02:22.307580 19442 leader_election.cc:302] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf35d1f36cf04b2680ddccff50cecf83, ea39fbf3b5ae40ed96daf1f323c303ae; no voters:
I20260812 07:02:22.307842 19304 raft_consensus.cc:2454] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf35d1f36cf04b2680ddccff50cecf83 in term 0.
I20260812 07:02:22.307966 19948 raft_consensus.cc:2781] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:02:22.308118 19948 raft_consensus.cc:482] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:02:22.308274 19948 raft_consensus.cc:3037] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:22.310539 19948 raft_consensus.cc:504] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf35d1f36cf04b2680ddccff50cecf83" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 37949 } } peers { permanent_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39633 } } peers { permanent_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44063 } }
I20260812 07:02:22.311085 19948 leader_election.cc:288] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [CANDIDATE]: Term 1 election: Requested vote from peers ea39fbf3b5ae40ed96daf1f323c303ae (127.18.70.131:39633), 7967b5e53ea64ee6b9aa9bd804f01a9b (127.18.70.129:44063)
I20260812 07:02:22.311447 19304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20419b5780c440ee838f7722576c63d6" candidate_uuid: "cf35d1f36cf04b2680ddccff50cecf83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b"
I20260812 07:02:22.311456 19817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20419b5780c440ee838f7722576c63d6" candidate_uuid: "cf35d1f36cf04b2680ddccff50cecf83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae"
I20260812 07:02:22.311605 19817 raft_consensus.cc:3037] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:22.311623 19304 raft_consensus.cc:3037] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:22.313747 19817 raft_consensus.cc:2454] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf35d1f36cf04b2680ddccff50cecf83 in term 1.
I20260812 07:02:22.313812 19304 raft_consensus.cc:2454] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf35d1f36cf04b2680ddccff50cecf83 in term 1.
I20260812 07:02:22.314111 19442 leader_election.cc:302] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf35d1f36cf04b2680ddccff50cecf83, ea39fbf3b5ae40ed96daf1f323c303ae; no voters:
I20260812 07:02:22.314378 19948 raft_consensus.cc:2781] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:22.314551 19948 raft_consensus.cc:686] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 1 LEADER]: Becoming Leader. State: Replica: cf35d1f36cf04b2680ddccff50cecf83, State: Running, Role: LEADER
I20260812 07:02:22.315032 19948 consensus_queue.cc:237] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf35d1f36cf04b2680ddccff50cecf83" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 37949 } } peers { permanent_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39633 } } peers { permanent_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44063 } }
I20260812 07:02:22.318845 19045 catalog_manager.cc:5495] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf35d1f36cf04b2680ddccff50cecf83 (127.18.70.130). New cstate: current_term: 1 leader_uuid: "cf35d1f36cf04b2680ddccff50cecf83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf35d1f36cf04b2680ddccff50cecf83" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44063 } health_report { overall_health: UNKNOWN } } }
I20260812 07:02:22.344880 19927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.339927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53756 (local address 127.18.70.130:37949)
0812 07:02:22.340124 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:22.340130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:22.340200 (+ 70us) server_negotiation.cc:407] Connection header received
0812 07:02:22.340359 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:22.340362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:22.340447 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:22.340564 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:02:22.340885 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.341551 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.343095 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.343484 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.343579 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.344005 (+ 426us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:02:22.344439 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:02:22.344550 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:22.344587 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 07:02:22.344642 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 07:02:22.351866 19304 raft_consensus.cc:1261] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b [term 1 FOLLOWER]: Refusing update from remote peer cf35d1f36cf04b2680ddccff50cecf83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:22.351866 19817 raft_consensus.cc:1261] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae [term 1 FOLLOWER]: Refusing update from remote peer cf35d1f36cf04b2680ddccff50cecf83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:22.352692 19948 consensus_queue.cc:1035] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea39fbf3b5ae40ed96daf1f323c303ae" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:22.352943 19945 consensus_queue.cc:1035] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7967b5e53ea64ee6b9aa9bd804f01a9b" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 44063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:22.367645 19966 mvcc.cc:205] Tried to move back new op lower bound from 7317578311065337856 to 7317578310925987840. Current Snapshot: MvccSnapshot[applied={T|T < 7317578311065337856}]
I20260812 07:02:22.380568 19048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:22.380846 19048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:22.384416 19048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9835ab0a89c9463caa8ac67ccb33c0fb: Sending DeleteTablet for 3 replicas of tablet 20419b5780c440ee838f7722576c63d6
I20260812 07:02:22.385486 19539 tablet_service.cc:1514] Processing DeleteTablet for tablet 20419b5780c440ee838f7722576c63d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:22 UTC) from {username='slave'} at 127.0.0.1:53740
I20260812 07:02:22.385489 19783 tablet_service.cc:1514] Processing DeleteTablet for tablet 20419b5780c440ee838f7722576c63d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:22 UTC) from {username='slave'} at 127.0.0.1:41124
I20260812 07:02:22.385718 19267 tablet_service.cc:1514] Processing DeleteTablet for tablet 20419b5780c440ee838f7722576c63d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:22 UTC) from {username='slave'} at 127.0.0.1:41040
I20260812 07:02:22.387279 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 19160
I20260812 07:02:22.397805 19980 tablet_replica.cc:330] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83: stopping tablet replica
I20260812 07:02:22.398336 19980 raft_consensus.cc:2229] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 1 LEADER]: Raft consensus shutting down.
I20260812 07:02:22.399150 19980 raft_consensus.cc:2258] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:22.399940 19982 tablet_replica.cc:330] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae: stopping tablet replica
I20260812 07:02:22.400334 19982 raft_consensus.cc:2229] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:02:22.400771 19982 raft_consensus.cc:2258] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:22.402630 19980 ts_tablet_manager.cc:1905] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:22.402757 19982 ts_tablet_manager.cc:1905] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:22.410001 19982 ts_tablet_manager.cc:1918] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:22.410128 19980 ts_tablet_manager.cc:1918] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:22.410218 19982 log.cc:1196] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/20419b5780c440ee838f7722576c63d6
I20260812 07:02:22.410352 19980 log.cc:1196] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/20419b5780c440ee838f7722576c63d6
I20260812 07:02:22.410801 19982 ts_tablet_manager.cc:1939] T 20419b5780c440ee838f7722576c63d6 P ea39fbf3b5ae40ed96daf1f323c303ae: Deleting consensus metadata
I20260812 07:02:22.411410 19980 ts_tablet_manager.cc:1939] T 20419b5780c440ee838f7722576c63d6 P cf35d1f36cf04b2680ddccff50cecf83: Deleting consensus metadata
I20260812 07:02:22.412642 19025 catalog_manager.cc:4841] TS ea39fbf3b5ae40ed96daf1f323c303ae (127.18.70.131:39633): tablet 20419b5780c440ee838f7722576c63d6 (table test-table [id=ea7f8343fc354b679e1764467c422dcd]) successfully deleted
I20260812 07:02:22.413118 19023 catalog_manager.cc:4841] TS cf35d1f36cf04b2680ddccff50cecf83 (127.18.70.130:37949): tablet 20419b5780c440ee838f7722576c63d6 (table test-table [id=ea7f8343fc354b679e1764467c422dcd]) successfully deleted
I20260812 07:02:22.414726 19985 tablet_replica.cc:330] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b: stopping tablet replica
I20260812 07:02:22.415125 19985 raft_consensus.cc:2229] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:02:22.415607 19985 raft_consensus.cc:2258] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:22.417101 19985 ts_tablet_manager.cc:1905] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:22.421512 19933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.388644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41050 (local address 127.18.70.129:44063)
0812 07:02:22.388819 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:22.388826 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:22.413268 (+ 24442us) server_negotiation.cc:407] Connection header received
0812 07:02:22.413527 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:22.413534 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:22.413690 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:22.413789 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:22.414346 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.415549 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.417930 (+ 2381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.418582 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.418712 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.419911 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:22.419922 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:22.419937 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:22.420665 (+ 728us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:22.420719 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:22.420741 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:22.420859 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:22.421015 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 07:02:22.421122 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 07:02:22.422251 19387 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:22.509701 19985 ts_tablet_manager.cc:1918] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:22.509990 19985 log.cc:1196] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/20419b5780c440ee838f7722576c63d6
I20260812 07:02:22.510406 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 19160
I20260812 07:02:22.510514 19985 ts_tablet_manager.cc:1939] T 20419b5780c440ee838f7722576c63d6 P 7967b5e53ea64ee6b9aa9bd804f01a9b: Deleting consensus metadata
W20260812 07:02:22.533087 19027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.70.129:44063 (error 108)
I20260812 07:02:22.533357 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 19403
I20260812 07:02:22.535641 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.535107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44063 (local address 127.0.0.1:41060)
0812 07:02:22.535359 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.535474 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
W20260812 07:02:22.535918 19027 catalog_manager.cc:4584] TS 7967b5e53ea64ee6b9aa9bd804f01a9b (127.18.70.129:44063): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 20419b5780c440ee838f7722576c63d6: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44063: connect: Connection refused (error 111)
I20260812 07:02:22.541551 19927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.534197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53762 (local address 127.18.70.130:37949)
0812 07:02:22.534397 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:22.534403 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:22.534742 (+ 339us) server_negotiation.cc:407] Connection header received
0812 07:02:22.534921 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:22.534926 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:22.535041 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:22.535165 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:22.535666 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.536623 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.538545 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.538964 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.539055 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.540152 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:22.540161 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:22.540175 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:22.540825 (+ 650us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:22.540874 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:22.540894 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:22.540974 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:22.541120 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 07:02:22.541199 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 07:02:22.542378 19651 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:22.589318 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.588885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44063 (local address 127.0.0.1:41072)
0812 07:02:22.589078 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.589159 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 07:02:22.590392 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.590050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44063 (local address 127.0.0.1:41074)
0812 07:02:22.590193 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.590259 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 07:02:22.650949 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.650381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44063 (local address 127.0.0.1:39364)
0812 07:02:22.650617 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.650726 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260812 07:02:22.652388 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.651957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44063 (local address 127.0.0.1:39380)
0812 07:02:22.652154 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.652249 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 07:02:22.652422 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 19403
I20260812 07:02:22.675837 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 19666
I20260812 07:02:22.682008 19930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.676518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57522 (local address 127.18.70.131:39633)
0812 07:02:22.676665 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:22.676670 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:22.676729 (+ 59us) server_negotiation.cc:407] Connection header received
0812 07:02:22.676872 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:22.676875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:22.676961 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:22.677052 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:22.677416 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.678178 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.679428 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:22.679816 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:22.679910 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:22.680823 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:22.680833 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:22.680848 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:22.681424 (+ 576us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:22.681471 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:22.681493 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:22.681584 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:22.681646 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 07:02:22.681731 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 07:02:22.682641 19889 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:22.734201 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.733722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44063 (local address 127.0.0.1:39396)
0812 07:02:22.733943 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.734034 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 07:02:22.735258 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.734876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44063 (local address 127.0.0.1:39408)
0812 07:02:22.735078 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.735147 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260812 07:02:22.770351 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 19666
I20260812 07:02:22.801029 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 18995
I20260812 07:02:22.802275 19109 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:22.913591 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 18995
I20260812 07:02:22.913659 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:22.913158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:44063 (local address 127.0.0.1:39420)
0812 07:02:22.913351 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:22.913443 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:44063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
2026-08-12T07:02:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2649 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:23 dist-test-slave-tc2s krb5kdc[20002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:23 dist-test-slave-tc2s krb5kdc[20002](info): set up 2 sockets
Aug 12 07:02:23 dist-test-slave-tc2s krb5kdc[20002](info): commencing operation
krb5kdc: starting...
W20260812 07:02:24.191831 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:24 dist-test-slave-tc2s krb5kdc[20002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:02:24.474888 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:35547
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:35547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:24.851691 20021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:24.851979 20021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:24.852097 20021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:24.859542 20021 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:24.859652 20021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:24.859704 20021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:24.859784 20021 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:24.859835 20021 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:24.869740 20021 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:35547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:35547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:24.871058 20021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:24.872393 20021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:24.884574 20035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:24.884536 20033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:24.884624 20031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:24.885776 20021 server_base.cc:1034] running on GCE node
I20260812 07:02:24.886590 20021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:24.887952 20021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:24.889146 20021 hybrid_clock.cc:648] HybridClock initialized: now 1786518144889091 us; error 45 us; skew 500 ppm
I20260812 07:02:24.889456 20021 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:24 dist-test-slave-tc2s krb5kdc[20002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518144, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:24.892553 20021 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:02:24.893932 20021 webserver.cc:460] Webserver started at http://127.18.70.190:44641/ using document root <none> and password file <none>
I20260812 07:02:24.894626 20021 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:24.894737 20021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:24.895006 20021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:24.898003 20021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "d5dd5dc357e04539baad82c3ce44c8cf"
format_stamp: "Formatted at 2026-08-12 07:02:24 on dist-test-slave-tc2s"
server_key: "5d9db287377879bc6e4a42a6b823c9cc"
server_key_iv: "4ceefd4a237fb405331a6cc0b14a544b"
server_key_version: "encryptionkey@0"
I20260812 07:02:24.898729 20021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "d5dd5dc357e04539baad82c3ce44c8cf"
format_stamp: "Formatted at 2026-08-12 07:02:24 on dist-test-slave-tc2s"
server_key: "5d9db287377879bc6e4a42a6b823c9cc"
server_key_iv: "4ceefd4a237fb405331a6cc0b14a544b"
server_key_version: "encryptionkey@0"
I20260812 07:02:24.904217 20021 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 07:02:24.907920 20050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:24.909392 20021 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 07:02:24.909572 20021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "d5dd5dc357e04539baad82c3ce44c8cf"
format_stamp: "Formatted at 2026-08-12 07:02:24 on dist-test-slave-tc2s"
server_key: "5d9db287377879bc6e4a42a6b823c9cc"
server_key_iv: "4ceefd4a237fb405331a6cc0b14a544b"
server_key_version: "encryptionkey@0"
I20260812 07:02:24.909773 20021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:24.945567 20021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:24.949940 20021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:24.950230 20021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:24.968528 20021 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:35547
I20260812 07:02:24.968552 20153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:35547 every 8 connection(s)
I20260812 07:02:24.969882 20021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:24.973640 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 20021
I20260812 07:02:24.973703 20154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:24.973812 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:24.974265 18714 external_mini_cluster.cc:1428] Setting key 77b798ad1d5253964460688c9209e3e6
I20260812 07:02:24.988216 20154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf: Bootstrap starting.
Aug 12 07:02:24 dist-test-slave-tc2s krb5kdc[20002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:24.991976 20154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:24.993422 20154 log.cc:824] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:24.996948 20154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf: No bootstrap required, opened a new log
I20260812 07:02:24.998919 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:24.976053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43820 (local address 127.18.70.190:35547)
0812 07:02:24.976929 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:24.976947 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:24.976996 (+ 49us) server_negotiation.cc:407] Connection header received
0812 07:02:24.978829 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:24.978869 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:24.979348 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:24.979788 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:24.981216 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:24.983231 (+ 2015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:24.984699 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:24.985799 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:24.986018 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:24.990205 (+ 4187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:24.990216 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:24.990234 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:24.990283 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:24.994303 (+ 4020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:24.995126 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:24.995134 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:24.995141 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:24.995346 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:24.995709 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:24.995714 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:24.995718 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:24.996434 (+ 716us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:24.996760 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:24.997097 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 07:02:24.997546 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":384,"threads_started":1}
I20260812 07:02:25.005740 20154 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5dd5dc357e04539baad82c3ce44c8cf" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35547 } }
I20260812 07:02:25.006181 20154 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:25.006259 20154 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5dd5dc357e04539baad82c3ce44c8cf, State: Initialized, Role: FOLLOWER
I20260812 07:02:25.006898 20154 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5dd5dc357e04539baad82c3ce44c8cf" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35547 } }
I20260812 07:02:25.007200 20154 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:25.007367 20154 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:25.007545 20154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:25.009696 20154 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5dd5dc357e04539baad82c3ce44c8cf" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35547 } }
I20260812 07:02:25.010216 20154 leader_election.cc:302] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5dd5dc357e04539baad82c3ce44c8cf; no voters:
I20260812 07:02:25.010746 20154 leader_election.cc:288] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:25.010879 20165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:25.011530 20165 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [term 1 LEADER]: Becoming Leader. State: Replica: d5dd5dc357e04539baad82c3ce44c8cf, State: Running, Role: LEADER
I20260812 07:02:25.012082 20165 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5dd5dc357e04539baad82c3ce44c8cf" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35547 } }
I20260812 07:02:25.012760 20154 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:25.015005 20168 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5dd5dc357e04539baad82c3ce44c8cf. Latest consensus state: current_term: 1 leader_uuid: "d5dd5dc357e04539baad82c3ce44c8cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5dd5dc357e04539baad82c3ce44c8cf" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35547 } } }
I20260812 07:02:25.015123 20167 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5dd5dc357e04539baad82c3ce44c8cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5dd5dc357e04539baad82c3ce44c8cf" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35547 } } }
I20260812 07:02:25.015642 20168 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:25.015643 20167 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:25.017478 20179 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:25.022893 20179 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:25.032214 20179 catalog_manager.cc:1347] Generated new cluster ID: bb8218bfc33a4eeca1e5cd5195c6b19f
I20260812 07:02:25.032351 20179 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:25.059824 20179 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:25.061187 20179 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:25.069309 20179 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf: Generated new TSK 0
I20260812 07:02:25.070405 20179 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 07:02:25.140658 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35547
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:25.491566 20209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:25.491865 20209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:25.491989 20209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:25.499545 20209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:25.499665 20209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:25.499796 20209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:02:25.510116 20209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35547
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:25.511467 20209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:25.512761 20209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:25.525807 20215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:25.525842 20216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:25.525770 20220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:25.526870 20209 server_base.cc:1034] running on GCE node
I20260812 07:02:25.527447 20209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:25.528409 20209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:25.529631 20209 hybrid_clock.cc:648] HybridClock initialized: now 1786518145529565 us; error 40 us; skew 500 ppm
I20260812 07:02:25.530010 20209 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:25 dist-test-slave-tc2s krb5kdc[20002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518145, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:25.533260 20209 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 07:02:25.534719 20209 webserver.cc:460] Webserver started at http://127.18.70.129:42119/ using document root <none> and password file <none>
I20260812 07:02:25.535389 20209 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:25.535506 20209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:25.535818 20209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:25.538821 20209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "9f3613ff169b4ee6868bcbdc91846136"
format_stamp: "Formatted at 2026-08-12 07:02:25 on dist-test-slave-tc2s"
server_key: "d2b4df2cf70bea42040b7004624e6aec"
server_key_iv: "a248d9e47cf116cc0409e200d0720756"
server_key_version: "encryptionkey@0"
I20260812 07:02:25.539608 20209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "9f3613ff169b4ee6868bcbdc91846136"
format_stamp: "Formatted at 2026-08-12 07:02:25 on dist-test-slave-tc2s"
server_key: "d2b4df2cf70bea42040b7004624e6aec"
server_key_iv: "a248d9e47cf116cc0409e200d0720756"
server_key_version: "encryptionkey@0"
I20260812 07:02:25.544834 20209 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 07:02:25.548295 20231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:25.549496 20209 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 07:02:25.549644 20209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "9f3613ff169b4ee6868bcbdc91846136"
format_stamp: "Formatted at 2026-08-12 07:02:25 on dist-test-slave-tc2s"
server_key: "d2b4df2cf70bea42040b7004624e6aec"
server_key_iv: "a248d9e47cf116cc0409e200d0720756"
server_key_version: "encryptionkey@0"
I20260812 07:02:25.549816 20209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:25.569718 20209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:25.574170 20209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:25.574441 20209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:25.575410 20209 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:25.576700 20209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:25.576776 20209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:25.576898 20209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:25.576952 20209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:25.608436 20209 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:46875
I20260812 07:02:25.608480 20445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:46875 every 8 connection(s)
I20260812 07:02:25.609740 20209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:02:25.619298 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 20209
I20260812 07:02:25.619511 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 07:02:25.620090 18714 external_mini_cluster.cc:1428] Setting key f89ef506dd21c0682e215a2e486440c6
Aug 12 07:02:25 dist-test-slave-tc2s krb5kdc[20002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518145, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:25.630772 20453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:25.612283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:47811 (local address 127.18.70.190:35547)
0812 07:02:25.612739 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:25.612744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:25.613649 (+ 905us) server_negotiation.cc:407] Connection header received
0812 07:02:25.615585 (+ 1936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:25.615591 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:25.615683 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:25.615781 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:25.617262 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:25.618068 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:25.620112 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:25.620604 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:25.620726 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:25.624506 (+ 3780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:25.624512 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:25.624517 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:25.624556 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:25.627682 (+ 3126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:25.628424 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:25.628429 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:25.628433 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:25.628580 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:25.628967 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:25.628971 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:25.628973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:25.629299 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:25.629442 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:25.630199 (+ 757us) server_negotiation.cc:299] Negotiation successful
0812 07:02:25.630431 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":240,"threads_started":1}
I20260812 07:02:25.631649 20455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:25.612756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:35547 (local address 127.18.70.129:47811)
0812 07:02:25.613495 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:25.613534 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:25.615321 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:25.616031 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:25.616039 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:25.616537 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:25.617089 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:25.617107 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:25.618224 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:25.618228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:25.619935 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:25.619951 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:25.620860 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:25.620869 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:25.621090 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:25.621776 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:02:25.621813 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:25.624265 (+ 2452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:25.627829 (+ 3564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:25.627837 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:25.627851 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:25.628284 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:25.628672 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:25.628676 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:25.628678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:25.628862 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:25.629421 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:25.629427 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:25.629771 (+ 344us) client_negotiation.cc:769] Sending connection context
0812 07:02:25.630061 (+ 290us) client_negotiation.cc:240] Negotiation successful
0812 07:02:25.630483 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":280,"threads_started":1}
I20260812 07:02:25.633211 20451 heartbeater.cc:347] Connected to a master server at 127.18.70.190:35547
I20260812 07:02:25.633510 20451 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:25.634255 20451 heartbeater.cc:511] Master 127.18.70.190:35547 requested a full tablet report, sending...
I20260812 07:02:25.636623 20088 ts_manager.cc:194] Registered new tserver with Master: 9f3613ff169b4ee6868bcbdc91846136 (127.18.70.129:46875)
I20260812 07:02:25.638644 20088 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:47811
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 07:02:25.687237 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35547
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:26.032517 20460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:26.032788 20460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:26.032882 20460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:26.040206 20460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:26.040356 20460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:26.040486 20460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:02:26.050604 20460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35547
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:26.051826 20460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:26.053110 20460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:26.066067 20472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:26.066087 20474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:26.066131 20477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:26.067477 20460 server_base.cc:1034] running on GCE node
I20260812 07:02:26.068104 20460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:26.069036 20460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:26.070245 20460 hybrid_clock.cc:648] HybridClock initialized: now 1786518146070178 us; error 65 us; skew 500 ppm
I20260812 07:02:26.070580 20460 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:26 dist-test-slave-tc2s krb5kdc[20002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518146, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:26.076678 20460 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 07:02:26.078267 20460 webserver.cc:460] Webserver started at http://127.18.70.130:45651/ using document root <none> and password file <none>
I20260812 07:02:26.079025 20460 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:26.079152 20460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:26.079464 20460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:26.082559 20460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "c573b9f5dc1449acb91e42c443c97a48"
format_stamp: "Formatted at 2026-08-12 07:02:26 on dist-test-slave-tc2s"
server_key: "acf1a74346830f126da8569a56ddb9ba"
server_key_iv: "f34e39e45cd078f07ab3803c320cb7f1"
server_key_version: "encryptionkey@0"
I20260812 07:02:26.083398 20460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "c573b9f5dc1449acb91e42c443c97a48"
format_stamp: "Formatted at 2026-08-12 07:02:26 on dist-test-slave-tc2s"
server_key: "acf1a74346830f126da8569a56ddb9ba"
server_key_iv: "f34e39e45cd078f07ab3803c320cb7f1"
server_key_version: "encryptionkey@0"
I20260812 07:02:26.088754 20460 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 07:02:26.092387 20491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:26.093714 20460 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 07:02:26.093874 20460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "c573b9f5dc1449acb91e42c443c97a48"
format_stamp: "Formatted at 2026-08-12 07:02:26 on dist-test-slave-tc2s"
server_key: "acf1a74346830f126da8569a56ddb9ba"
server_key_iv: "f34e39e45cd078f07ab3803c320cb7f1"
server_key_version: "encryptionkey@0"
I20260812 07:02:26.094130 20460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:26.116542 20460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:26.120947 20460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:26.121263 20460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:26.122364 20460 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:26.123703 20460 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:26.123778 20460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:26.123871 20460 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:26.123914 20460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:26.155642 20460 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:46229
I20260812 07:02:26.155690 20703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:46229 every 8 connection(s)
I20260812 07:02:26.156988 20460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:02:26.166253 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 20460
I20260812 07:02:26.166425 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 07:02:26.166848 18714 external_mini_cluster.cc:1428] Setting key 86db8d696ca9253847827cb07cf79390
Aug 12 07:02:26 dist-test-slave-tc2s krb5kdc[20002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518146, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:26.177342 20709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.159524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:59985 (local address 127.18.70.190:35547)
0812 07:02:26.159952 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:26.159957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:26.160942 (+ 985us) server_negotiation.cc:407] Connection header received
0812 07:02:26.162874 (+ 1932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:26.162880 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:26.162961 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:26.163058 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:26.164589 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.165294 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.166938 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.167417 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.167552 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.171348 (+ 3796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:26.171355 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:26.171359 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:26.171398 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:26.174410 (+ 3012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:26.175092 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:26.175097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:26.175099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:26.175259 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:26.175662 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:26.175666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:26.175668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:26.175995 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:26.176128 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:26.176792 (+ 664us) server_negotiation.cc:299] Negotiation successful
0812 07:02:26.177014 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":203,"threads_started":1}
I20260812 07:02:26.178247 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.160050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:35547 (local address 127.18.70.130:59985)
0812 07:02:26.160763 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:26.160809 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:26.162602 (+ 1793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:26.163298 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:26.163306 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:26.163853 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:26.164406 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.164429 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.165449 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.165453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.166787 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.166801 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.167659 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.167667 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.167944 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.168576 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:02:26.168604 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:26.171124 (+ 2520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:26.174538 (+ 3414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:26.174544 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:26.174556 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:26.174968 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:26.175373 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:26.175377 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:26.175379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:26.175559 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:26.176099 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:26.176105 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:26.176424 (+ 319us) client_negotiation.cc:769] Sending connection context
0812 07:02:26.176645 (+ 221us) client_negotiation.cc:240] Negotiation successful
0812 07:02:26.177015 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":270,"threads_started":1}
I20260812 07:02:26.179729 20706 heartbeater.cc:347] Connected to a master server at 127.18.70.190:35547
I20260812 07:02:26.180054 20706 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:26.180967 20706 heartbeater.cc:511] Master 127.18.70.190:35547 requested a full tablet report, sending...
I20260812 07:02:26.182637 20088 ts_manager.cc:194] Registered new tserver with Master: c573b9f5dc1449acb91e42c443c97a48 (127.18.70.130:46229)
I20260812 07:02:26.183494 20088 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:59985
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 07:02:26.231448 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35547
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:26.572675 20714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:26.572973 20714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:26.573071 20714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:26.580442 20714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:26.580554 20714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:26.580667 20714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:02:26.590371 20714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35547
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:26.591610 20714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:26.592973 20714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:26.605842 20722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:26.605929 20725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:26.605880 20721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:26.607697 20714 server_base.cc:1034] running on GCE node
I20260812 07:02:26.608333 20714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:26.609230 20714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:26.610425 20714 hybrid_clock.cc:648] HybridClock initialized: now 1786518146610378 us; error 46 us; skew 500 ppm
I20260812 07:02:26.610728 20714 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:26 dist-test-slave-tc2s krb5kdc[20002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518146, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:26.613864 20714 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 07:02:26.615289 20714 webserver.cc:460] Webserver started at http://127.18.70.131:44183/ using document root <none> and password file <none>
I20260812 07:02:26.615981 20714 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:26.616111 20714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:26.616415 20714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:26.619531 20714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "8d34d78b7bb44ad9a1464720e127282b"
format_stamp: "Formatted at 2026-08-12 07:02:26 on dist-test-slave-tc2s"
server_key: "412355b4bb5206ff9eea49fbf655783e"
server_key_iv: "2392841eddbfbfb0bb6f61eca8862a8a"
server_key_version: "encryptionkey@0"
I20260812 07:02:26.620294 20714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "8d34d78b7bb44ad9a1464720e127282b"
format_stamp: "Formatted at 2026-08-12 07:02:26 on dist-test-slave-tc2s"
server_key: "412355b4bb5206ff9eea49fbf655783e"
server_key_iv: "2392841eddbfbfb0bb6f61eca8862a8a"
server_key_version: "encryptionkey@0"
I20260812 07:02:26.625377 20714 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 07:02:26.628832 20736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:26.630157 20714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:02:26.630316 20714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "8d34d78b7bb44ad9a1464720e127282b"
format_stamp: "Formatted at 2026-08-12 07:02:26 on dist-test-slave-tc2s"
server_key: "412355b4bb5206ff9eea49fbf655783e"
server_key_iv: "2392841eddbfbfb0bb6f61eca8862a8a"
server_key_version: "encryptionkey@0"
I20260812 07:02:26.630496 20714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:26.642198 20451 heartbeater.cc:503] Master 127.18.70.190:35547 was elected leader, sending a full tablet report...
I20260812 07:02:26.647909 20714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:26.651886 20714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:26.652144 20714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:26.653116 20714 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:26.654523 20714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:26.654606 20714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:26.654727 20714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:26.654774 20714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:26.686174 20714 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:42391
I20260812 07:02:26.686213 20943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:42391 every 8 connection(s)
I20260812 07:02:26.687460 20714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:02:26.689394 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 20714
I20260812 07:02:26.689584 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 07:02:26.690207 18714 external_mini_cluster.cc:1428] Setting key 6b097f9e91782cd5b4c063d1dc7f5214
Aug 12 07:02:26 dist-test-slave-tc2s krb5kdc[20002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518146, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:26.707463 20947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.690328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:42197 (local address 127.18.70.190:35547)
0812 07:02:26.690813 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:26.690818 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:26.692089 (+ 1271us) server_negotiation.cc:407] Connection header received
0812 07:02:26.694007 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:26.694012 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:26.694110 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:26.694202 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:26.695680 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.696472 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.698157 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.698550 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.698683 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.701952 (+ 3269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:26.701957 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:26.701960 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:26.701992 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:26.704354 (+ 2362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:26.705000 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:26.705005 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:26.705009 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:26.705127 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:26.705748 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:26.705752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:26.705753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:26.706057 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:26.706208 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:26.706852 (+ 644us) server_negotiation.cc:299] Negotiation successful
0812 07:02:26.707086 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":226,"threads_started":1}
I20260812 07:02:26.708287 20948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.690985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:35547 (local address 127.18.70.131:42197)
0812 07:02:26.691913 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:26.691973 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:26.693735 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:26.694454 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:26.694461 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:26.694981 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:26.695519 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.695536 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.696629 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.696634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.698024 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.698037 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.698768 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.698775 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.699041 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.699643 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:02:26.699669 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:26.701709 (+ 2040us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:26.704482 (+ 2773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:26.704490 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:26.704504 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:26.704885 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:26.705230 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:26.705234 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:26.705238 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:26.705430 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:26.706189 (+ 759us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:26.706196 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:26.706508 (+ 312us) client_negotiation.cc:769] Sending connection context
0812 07:02:26.706735 (+ 227us) client_negotiation.cc:240] Negotiation successful
0812 07:02:26.707207 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":369,"threads_started":1}
I20260812 07:02:26.709559 20944 heartbeater.cc:347] Connected to a master server at 127.18.70.190:35547
I20260812 07:02:26.709806 20944 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:26.710510 20944 heartbeater.cc:511] Master 127.18.70.190:35547 requested a full tablet report, sending...
I20260812 07:02:26.711848 20088 ts_manager.cc:194] Registered new tserver with Master: 8d34d78b7bb44ad9a1464720e127282b (127.18.70.131:42391)
I20260812 07:02:26.712636 20088 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:42197
I20260812 07:02:26.717211 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 07:02:26.734344 20947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.721346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43828 (local address 127.18.70.190:35547)
0812 07:02:26.721494 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:26.721498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:26.722046 (+ 548us) server_negotiation.cc:407] Connection header received
0812 07:02:26.722171 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:26.722174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:26.722235 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:26.722311 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:26.723730 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.724463 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.725918 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.726347 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.726451 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.729004 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:26.729008 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:26.729012 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:26.729042 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:26.731595 (+ 2553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:26.732361 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:26.732365 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:26.732367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:26.732482 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:26.732928 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:26.732932 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:26.732934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:26.733233 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:26.733512 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:26.733885 (+ 373us) server_negotiation.cc:299] Negotiation successful
0812 07:02:26.734095 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 07:02:26.738286 20088 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43828:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 07:02:26.745345 20088 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 07:02:26.769129 20973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.758081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53342 (local address 127.18.70.130:46229)
0812 07:02:26.758884 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:26.758893 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:26.759338 (+ 445us) server_negotiation.cc:407] Connection header received
0812 07:02:26.759532 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:26.759540 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:26.759798 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:26.759989 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:26.761355 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.763072 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.765886 (+ 2814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.767497 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.767614 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.767836 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:26.768563 (+ 727us) server_negotiation.cc:299] Negotiation successful
0812 07:02:26.768756 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":324,"threads_started":1}
I20260812 07:02:26.769912 20970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.757452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:46229 (local address 127.0.0.1:53342)
0812 07:02:26.759226 (+ 1774us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:26.759240 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:26.759355 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:26.760284 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:26.760292 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:26.760338 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:26.760806 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.760819 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.763276 (+ 2457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.763282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.765679 (+ 2397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.765696 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.768064 (+ 2368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.768070 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.768294 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.768345 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 07:02:26.769336 (+ 991us) client_negotiation.cc:240] Negotiation successful
0812 07:02:26.769536 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1677,"thread_start_us":1622,"threads_started":1}
I20260812 07:02:26.775933 20571 tablet_service.cc:1467] Processing CreateTablet for tablet d84d09d214f44b36a24c20ab5c5ce3fc (DEFAULT_TABLE table=test-table [id=59ac824e38a44e9985c12838132156df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:26.777364 20965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.757098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46875 (local address 127.0.0.1:46510)
0812 07:02:26.757852 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:26.757928 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:26.758084 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:26.771241 (+ 13157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:26.771246 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:26.771270 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:26.771661 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.771672 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.773245 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.773250 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.775283 (+ 2033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.775296 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.776583 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.776591 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.776782 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.776806 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 07:02:26.776901 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 07:02:26.777035 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":358,"threads_started":1}
I20260812 07:02:26.777437 20968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.757443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46510 (local address 127.18.70.129:46875)
0812 07:02:26.770614 (+ 13171us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:26.770624 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:26.770656 (+ 32us) server_negotiation.cc:407] Connection header received
0812 07:02:26.770768 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:26.770778 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:26.771042 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:26.771254 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:26.771890 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.773096 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.775444 (+ 2348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.776356 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.776490 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.776722 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:26.776957 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 07:02:26.777125 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12964,"thread_start_us":13995,"threads_started":1}
I20260812 07:02:26.777566 20571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d84d09d214f44b36a24c20ab5c5ce3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:26.779475 20970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.759459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:42391 (local address 127.0.0.1:38990)
0812 07:02:26.770353 (+ 10894us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:26.770372 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:26.770473 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:26.772961 (+ 2488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:26.772966 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:26.772991 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:26.773184 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.773196 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.775186 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.775191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.776959 (+ 1768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.776975 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.778686 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.778692 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.778869 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.778923 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 07:02:26.779016 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 07:02:26.779153 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10795,"mutex_wait_us":1,"thread_start_us":12336,"threads_started":1}
I20260812 07:02:26.779561 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.759924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38990 (local address 127.18.70.131:42391)
0812 07:02:26.772441 (+ 12517us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:26.772448 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:26.772477 (+ 29us) server_negotiation.cc:407] Connection header received
0812 07:02:26.772562 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:26.772569 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:26.772762 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:26.772950 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:26.773362 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.775020 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.777147 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.778524 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.778657 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.778882 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:26.779073 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 07:02:26.779225 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12337,"thread_start_us":12187,"threads_started":1}
I20260812 07:02:26.781137 20324 tablet_service.cc:1467] Processing CreateTablet for tablet d84d09d214f44b36a24c20ab5c5ce3fc (DEFAULT_TABLE table=test-table [id=59ac824e38a44e9985c12838132156df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:26.782277 20324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d84d09d214f44b36a24c20ab5c5ce3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:26.789631 20980 tablet_bootstrap.cc:492] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: Bootstrap starting.
I20260812 07:02:26.790858 20828 tablet_service.cc:1467] Processing CreateTablet for tablet d84d09d214f44b36a24c20ab5c5ce3fc (DEFAULT_TABLE table=test-table [id=59ac824e38a44e9985c12838132156df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:26.792320 20828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d84d09d214f44b36a24c20ab5c5ce3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:26.792814 20980 tablet_bootstrap.cc:654] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:26.793875 20980 log.cc:824] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:26.794297 20982 tablet_bootstrap.cc:492] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: Bootstrap starting.
I20260812 07:02:26.797991 20982 tablet_bootstrap.cc:654] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:26.798496 20980 tablet_bootstrap.cc:492] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: No bootstrap required, opened a new log
I20260812 07:02:26.798774 20980 ts_tablet_manager.cc:1397] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260812 07:02:26.799278 20982 log.cc:824] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:26.802284 20982 tablet_bootstrap.cc:492] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: No bootstrap required, opened a new log
I20260812 07:02:26.802537 20982 ts_tablet_manager.cc:1397] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260812 07:02:26.804697 20989 tablet_bootstrap.cc:492] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: Bootstrap starting.
I20260812 07:02:26.807852 20989 tablet_bootstrap.cc:654] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:26.808893 20989 log.cc:824] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:26.810199 20980 raft_consensus.cc:348] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3613ff169b4ee6868bcbdc91846136" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46875 } } peers { permanent_uuid: "c573b9f5dc1449acb91e42c443c97a48" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46229 } } peers { permanent_uuid: "8d34d78b7bb44ad9a1464720e127282b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42391 } }
I20260812 07:02:26.810640 20980 raft_consensus.cc:374] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:26.810751 20980 raft_consensus.cc:729] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c573b9f5dc1449acb91e42c443c97a48, State: Initialized, Role: FOLLOWER
I20260812 07:02:26.811478 20989 tablet_bootstrap.cc:492] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: No bootstrap required, opened a new log
I20260812 07:02:26.811369 20980 consensus_queue.cc:260] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3613ff169b4ee6868bcbdc91846136" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46875 } } peers { permanent_uuid: "c573b9f5dc1449acb91e42c443c97a48" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46229 } } peers { permanent_uuid: "8d34d78b7bb44ad9a1464720e127282b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42391 } }
I20260812 07:02:26.811724 20989 ts_tablet_manager.cc:1397] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260812 07:02:26.813140 20982 raft_consensus.cc:348] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3613ff169b4ee6868bcbdc91846136" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46875 } } peers { permanent_uuid: "c573b9f5dc1449acb91e42c443c97a48" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46229 } } peers { permanent_uuid: "8d34d78b7bb44ad9a1464720e127282b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42391 } }
I20260812 07:02:26.813558 20982 raft_consensus.cc:374] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:26.813656 20982 raft_consensus.cc:729] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3613ff169b4ee6868bcbdc91846136, State: Initialized, Role: FOLLOWER
I20260812 07:02:26.814009 20706 heartbeater.cc:503] Master 127.18.70.190:35547 was elected leader, sending a full tablet report...
I20260812 07:02:26.814606 20980 ts_tablet_manager.cc:1428] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260812 07:02:26.815209 20982 consensus_queue.cc:260] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3613ff169b4ee6868bcbdc91846136" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46875 } } peers { permanent_uuid: "c573b9f5dc1449acb91e42c443c97a48" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46229 } } peers { permanent_uuid: "8d34d78b7bb44ad9a1464720e127282b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42391 } }
I20260812 07:02:26.818552 20982 ts_tablet_manager.cc:1428] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: Time spent starting tablet: real 0.016s user 0.008s sys 0.005s
I20260812 07:02:26.822319 20989 raft_consensus.cc:348] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3613ff169b4ee6868bcbdc91846136" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46875 } } peers { permanent_uuid: "c573b9f5dc1449acb91e42c443c97a48" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46229 } } peers { permanent_uuid: "8d34d78b7bb44ad9a1464720e127282b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42391 } }
I20260812 07:02:26.822666 20989 raft_consensus.cc:374] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:26.822762 20989 raft_consensus.cc:729] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d34d78b7bb44ad9a1464720e127282b, State: Initialized, Role: FOLLOWER
I20260812 07:02:26.823271 20989 consensus_queue.cc:260] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3613ff169b4ee6868bcbdc91846136" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46875 } } peers { permanent_uuid: "c573b9f5dc1449acb91e42c443c97a48" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46229 } } peers { permanent_uuid: "8d34d78b7bb44ad9a1464720e127282b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42391 } }
I20260812 07:02:26.824183 20944 heartbeater.cc:503] Master 127.18.70.190:35547 was elected leader, sending a full tablet report...
I20260812 07:02:26.824749 20989 ts_tablet_manager.cc:1428] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
W20260812 07:02:26.862125 20452 tablet.cc:2369] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:02:26.909083 20708 tablet.cc:2369] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:02:26.916890 20998 raft_consensus.cc:482] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:02:26.917191 20998 raft_consensus.cc:504] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3613ff169b4ee6868bcbdc91846136" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46875 } } peers { permanent_uuid: "c573b9f5dc1449acb91e42c443c97a48" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46229 } } peers { permanent_uuid: "8d34d78b7bb44ad9a1464720e127282b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42391 } }
I20260812 07:02:26.919138 20998 leader_election.cc:288] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f3613ff169b4ee6868bcbdc91846136 (127.18.70.129:46875), c573b9f5dc1449acb91e42c443c97a48 (127.18.70.130:46229)
I20260812 07:02:26.925693 20973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.919819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:57409 (local address 127.18.70.130:46229)
0812 07:02:26.920047 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:26.920053 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:26.920072 (+ 19us) server_negotiation.cc:407] Connection header received
0812 07:02:26.920149 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:26.920154 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:26.920235 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:26.920363 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:26.920748 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.921693 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.923593 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.924836 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.924965 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.925018 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:26.925378 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 07:02:26.925472 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 07:02:26.926025 20948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.919432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:46229 (local address 127.18.70.131:57409)
0812 07:02:26.919661 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:26.919682 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:26.919810 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:26.920380 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:26.920384 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:26.920408 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:26.920606 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.920617 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.921840 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.921846 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.923420 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.923436 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.925005 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.925012 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.925206 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.925242 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 07:02:26.925344 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 07:02:26.925484 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":21}
I20260812 07:02:26.926614 20999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.919557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:46875 (local address 127.18.70.131:46965)
0812 07:02:26.920378 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:26.920396 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:26.920515 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:26.920839 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:26.920843 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:26.920867 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:26.921221 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.921232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.922489 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.922493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.924403 (+ 1910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:26.924419 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.925874 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.925881 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:26.926050 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.926077 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 07:02:26.926215 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 07:02:26.926325 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"mutex_wait_us":1,"thread_start_us":420,"threads_started":1}
I20260812 07:02:26.926636 20968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.919502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:46965 (local address 127.18.70.129:46875)
0812 07:02:26.919777 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:26.919782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:26.920486 (+ 704us) server_negotiation.cc:407] Connection header received
0812 07:02:26.920638 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:26.920644 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:26.920722 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:26.920799 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:26.921387 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.922307 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.924600 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.925660 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.925821 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.925887 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:26.926274 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 07:02:26.926420 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260812 07:02:26.927121 20622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d84d09d214f44b36a24c20ab5c5ce3fc" candidate_uuid: "8d34d78b7bb44ad9a1464720e127282b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c573b9f5dc1449acb91e42c443c97a48" is_pre_election: true
I20260812 07:02:26.927670 20622 raft_consensus.cc:2454] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d34d78b7bb44ad9a1464720e127282b in term 0.
I20260812 07:02:26.927659 20365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d84d09d214f44b36a24c20ab5c5ce3fc" candidate_uuid: "8d34d78b7bb44ad9a1464720e127282b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3613ff169b4ee6868bcbdc91846136" is_pre_election: true
I20260812 07:02:26.928129 20365 raft_consensus.cc:2454] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d34d78b7bb44ad9a1464720e127282b in term 0.
I20260812 07:02:26.928355 20743 leader_election.cc:302] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d34d78b7bb44ad9a1464720e127282b, c573b9f5dc1449acb91e42c443c97a48; no voters:
I20260812 07:02:26.928768 20998 raft_consensus.cc:2781] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:02:26.928894 20998 raft_consensus.cc:482] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:02:26.928994 20998 raft_consensus.cc:3037] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:26.931314 20998 raft_consensus.cc:504] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3613ff169b4ee6868bcbdc91846136" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46875 } } peers { permanent_uuid: "c573b9f5dc1449acb91e42c443c97a48" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46229 } } peers { permanent_uuid: "8d34d78b7bb44ad9a1464720e127282b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42391 } }
I20260812 07:02:26.931919 20998 leader_election.cc:288] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [CANDIDATE]: Term 1 election: Requested vote from peers 9f3613ff169b4ee6868bcbdc91846136 (127.18.70.129:46875), c573b9f5dc1449acb91e42c443c97a48 (127.18.70.130:46229)
I20260812 07:02:26.932366 20622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d84d09d214f44b36a24c20ab5c5ce3fc" candidate_uuid: "8d34d78b7bb44ad9a1464720e127282b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c573b9f5dc1449acb91e42c443c97a48"
I20260812 07:02:26.932411 20365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d84d09d214f44b36a24c20ab5c5ce3fc" candidate_uuid: "8d34d78b7bb44ad9a1464720e127282b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3613ff169b4ee6868bcbdc91846136"
I20260812 07:02:26.932554 20622 raft_consensus.cc:3037] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:26.932579 20365 raft_consensus.cc:3037] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:26.934870 20622 raft_consensus.cc:2454] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d34d78b7bb44ad9a1464720e127282b in term 1.
I20260812 07:02:26.934935 20365 raft_consensus.cc:2454] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d34d78b7bb44ad9a1464720e127282b in term 1.
I20260812 07:02:26.935259 20743 leader_election.cc:302] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d34d78b7bb44ad9a1464720e127282b, c573b9f5dc1449acb91e42c443c97a48; no voters:
I20260812 07:02:26.935513 20998 raft_consensus.cc:2781] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:26.935912 20998 raft_consensus.cc:686] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 1 LEADER]: Becoming Leader. State: Replica: 8d34d78b7bb44ad9a1464720e127282b, State: Running, Role: LEADER
I20260812 07:02:26.936347 20998 consensus_queue.cc:237] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3613ff169b4ee6868bcbdc91846136" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46875 } } peers { permanent_uuid: "c573b9f5dc1449acb91e42c443c97a48" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46229 } } peers { permanent_uuid: "8d34d78b7bb44ad9a1464720e127282b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42391 } }
W20260812 07:02:26.939100 20945 tablet.cc:2369] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:02:26.941267 20088 catalog_manager.cc:5495] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d34d78b7bb44ad9a1464720e127282b (127.18.70.131). New cstate: current_term: 1 leader_uuid: "8d34d78b7bb44ad9a1464720e127282b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3613ff169b4ee6868bcbdc91846136" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c573b9f5dc1449acb91e42c443c97a48" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d34d78b7bb44ad9a1464720e127282b" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42391 } health_report { overall_health: HEALTHY } } }
I20260812 07:02:26.958855 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:26.953965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39006 (local address 127.18.70.131:42391)
0812 07:02:26.954150 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:26.954155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:26.954191 (+ 36us) server_negotiation.cc:407] Connection header received
0812 07:02:26.954264 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:26.954268 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:26.954342 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:26.954495 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:02:26.954876 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.955629 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.956929 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:26.957320 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:26.957416 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:26.957806 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:02:26.958324 (+ 518us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:02:26.958457 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:26.958570 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 07:02:26.958612 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 07:02:26.966959 20622 raft_consensus.cc:1261] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48 [term 1 FOLLOWER]: Refusing update from remote peer 8d34d78b7bb44ad9a1464720e127282b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:26.966966 20365 raft_consensus.cc:1261] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136 [term 1 FOLLOWER]: Refusing update from remote peer 8d34d78b7bb44ad9a1464720e127282b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:26.967933 21000 consensus_queue.cc:1035] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3613ff169b4ee6868bcbdc91846136" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 46875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:26.968286 20998 consensus_queue.cc:1035] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c573b9f5dc1449acb91e42c443c97a48" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:26.982030 21009 mvcc.cc:205] Tried to move back new op lower bound from 7317578329966575616 to 7317578329854869504. Current Snapshot: MvccSnapshot[applied={T|T < 7317578329966575616}]
I20260812 07:02:26.992988 21013 mvcc.cc:205] Tried to move back new op lower bound from 7317578329966575616 to 7317578329854869504. Current Snapshot: MvccSnapshot[applied={T|T < 7317578329966575616}]
I20260812 07:02:27.004065 20088 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:27.004311 20088 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:27.008016 20088 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d5dd5dc357e04539baad82c3ce44c8cf: Sending DeleteTablet for 3 replicas of tablet d84d09d214f44b36a24c20ab5c5ce3fc
I20260812 07:02:27.009166 20324 tablet_service.cc:1514] Processing DeleteTablet for tablet d84d09d214f44b36a24c20ab5c5ce3fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:26 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:46510
I20260812 07:02:27.009490 20828 tablet_service.cc:1514] Processing DeleteTablet for tablet d84d09d214f44b36a24c20ab5c5ce3fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:26 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:38990
I20260812 07:02:27.009639 20571 tablet_service.cc:1514] Processing DeleteTablet for tablet d84d09d214f44b36a24c20ab5c5ce3fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:26 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:53342
I20260812 07:02:27.010943 21029 tablet_replica.cc:330] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: stopping tablet replica
I20260812 07:02:27.011348 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 20209
I20260812 07:02:27.011466 21029 raft_consensus.cc:2229] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:02:27.012041 21029 raft_consensus.cc:2258] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:27.012941 21027 tablet_replica.cc:330] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: stopping tablet replica
I20260812 07:02:27.013309 21027 raft_consensus.cc:2229] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:02:27.013751 21027 raft_consensus.cc:2258] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:27.014510 21028 tablet_replica.cc:330] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: stopping tablet replica
I20260812 07:02:27.014830 21029 ts_tablet_manager.cc:1905] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:27.015079 21028 raft_consensus.cc:2229] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 1 LEADER]: Raft consensus shutting down.
I20260812 07:02:27.015785 21028 raft_consensus.cc:2258] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:27.017951 21028 ts_tablet_manager.cc:1905] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:27.022249 21029 ts_tablet_manager.cc:1918] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:27.022454 21029 log.cc:1196] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/d84d09d214f44b36a24c20ab5c5ce3fc
I20260812 07:02:27.023042 21029 ts_tablet_manager.cc:1939] T d84d09d214f44b36a24c20ab5c5ce3fc P c573b9f5dc1449acb91e42c443c97a48: Deleting consensus metadata
I20260812 07:02:27.023878 21027 ts_tablet_manager.cc:1905] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:27.024989 20055 catalog_manager.cc:4841] TS c573b9f5dc1449acb91e42c443c97a48 (127.18.70.130:46229): tablet d84d09d214f44b36a24c20ab5c5ce3fc (table test-table [id=59ac824e38a44e9985c12838132156df]) successfully deleted
I20260812 07:02:27.026338 21028 ts_tablet_manager.cc:1918] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:27.026551 21028 log.cc:1196] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/d84d09d214f44b36a24c20ab5c5ce3fc
I20260812 07:02:27.027164 21028 ts_tablet_manager.cc:1939] T d84d09d214f44b36a24c20ab5c5ce3fc P 8d34d78b7bb44ad9a1464720e127282b: Deleting consensus metadata
I20260812 07:02:27.028882 20055 catalog_manager.cc:4841] TS 8d34d78b7bb44ad9a1464720e127282b (127.18.70.131:42391): tablet d84d09d214f44b36a24c20ab5c5ce3fc (table test-table [id=59ac824e38a44e9985c12838132156df]) successfully deleted
I20260812 07:02:27.031704 21027 ts_tablet_manager.cc:1918] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:27.031962 21027 log.cc:1196] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/d84d09d214f44b36a24c20ab5c5ce3fc
I20260812 07:02:27.032444 21027 ts_tablet_manager.cc:1939] T d84d09d214f44b36a24c20ab5c5ce3fc P 9f3613ff169b4ee6868bcbdc91846136: Deleting consensus metadata
I20260812 07:02:27.034364 20052 catalog_manager.cc:4841] TS 9f3613ff169b4ee6868bcbdc91846136 (127.18.70.129:46875): tablet d84d09d214f44b36a24c20ab5c5ce3fc (table test-table [id=59ac824e38a44e9985c12838132156df]) successfully deleted
Aug 12 07:02:27 dist-test-slave-tc2s krb5kdc[20002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 07:02:27.043583 20968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:27.012819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46516 (local address 127.18.70.129:46875)
0812 07:02:27.013006 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:27.013012 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:27.025438 (+ 12426us) server_negotiation.cc:407] Connection header received
0812 07:02:27.025750 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:27.025756 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:27.025847 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:27.025974 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:27.027784 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:27.028875 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:27.030870 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:27.031536 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:27.031673 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:27.036715 (+ 5042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:27.036731 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:27.036751 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:27.036798 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:27.040510 (+ 3712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:27.041222 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:27.041233 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:27.041237 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:27.041424 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:27.041845 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:27.041849 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:27.041852 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:27.042382 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:27.042707 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:27.042922 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 07:02:27.043180 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 07:02:27.044222 20438 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:27.132968 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 20209
I20260812 07:02:27.156373 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 20460
Aug 12 07:02:27 dist-test-slave-tc2s krb5kdc[20002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 07:02:27.172096 20973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:27.157261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53356 (local address 127.18.70.130:46229)
0812 07:02:27.157455 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:27.157462 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:27.157542 (+ 80us) server_negotiation.cc:407] Connection header received
0812 07:02:27.157742 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:27.157746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:27.157813 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:27.157941 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:27.159250 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:27.160036 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:27.161374 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:27.161825 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:27.161983 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:27.166178 (+ 4195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:27.166193 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:27.166207 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:27.166245 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:27.169224 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:27.169948 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:27.169955 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:27.169957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:27.170083 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:27.170476 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:27.170480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:27.170482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:27.170902 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:27.171172 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:27.171495 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 07:02:27.171715 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 07:02:27.172812 20693 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:27.262102 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 20460
I20260812 07:02:27.293787 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 20714
Aug 12 07:02:27 dist-test-slave-tc2s krb5kdc[20002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 07:02:27.309589 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:27.294558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39014 (local address 127.18.70.131:42391)
0812 07:02:27.294772 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:27.294778 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:27.294797 (+ 19us) server_negotiation.cc:407] Connection header received
0812 07:02:27.294939 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:27.294945 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:27.295027 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:27.295115 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:27.296469 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:27.297344 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:27.298824 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:27.299282 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:27.299399 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:27.303787 (+ 4388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:27.303800 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:27.303817 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:27.303848 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:27.306805 (+ 2957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:27.307619 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:27.307625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:27.307631 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:27.307791 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:27.308210 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:27.308213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:27.308215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:27.308563 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:27.308801 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:27.309127 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 07:02:27.309290 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 07:02:27.310384 20937 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:27.431231 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 20714
I20260812 07:02:27.459053 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 20021
I20260812 07:02:27.460081 20145 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:27.568848 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 20021
2026-08-12T07:02:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4655 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T07:02:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:27Z Disabled control of system clock
I20260812 07:02:27.655902 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:45151
--webserver_interface=127.18.70.190
--webserver_port=0
--builtin_ntp_servers=127.18.70.148:44645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:45151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 07:02:27.982359 21042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:27.982640 21042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:27.982751 21042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:27.990188 21042 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:27.990291 21042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:27.990357 21042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:27.990442 21042 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:27.990495 21042 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:27.999694 21042 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:45151
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:45151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:28.001003 21042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:28.002867 21042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:28.014323 21057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:28.014390 21062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:28.014395 21056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:28.015368 21042 server_base.cc:1034] running on GCE node
I20260812 07:02:28.016157 21042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:28.017485 21042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:28.018680 21042 hybrid_clock.cc:648] HybridClock initialized: now 1786518148018630 us; error 38 us; skew 500 ppm
I20260812 07:02:28.019014 21042 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:28.021195 21042 webserver.cc:460] Webserver started at http://127.18.70.190:45327/ using document root <none> and password file <none>
I20260812 07:02:28.021857 21042 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:28.021994 21042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:28.022302 21042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:28.025151 21042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "80e6b7b26dbe4e78a47d955cde8cad8b"
format_stamp: "Formatted at 2026-08-12 07:02:28 on dist-test-slave-tc2s"
server_key: "e3126e85286a68c3659095c4491ff2a6"
server_key_iv: "20d13777efe49f0f6d87fbdef277009d"
server_key_version: "encryptionkey@0"
I20260812 07:02:28.026033 21042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "80e6b7b26dbe4e78a47d955cde8cad8b"
format_stamp: "Formatted at 2026-08-12 07:02:28 on dist-test-slave-tc2s"
server_key: "e3126e85286a68c3659095c4491ff2a6"
server_key_iv: "20d13777efe49f0f6d87fbdef277009d"
server_key_version: "encryptionkey@0"
I20260812 07:02:28.030969 21042 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260812 07:02:28.034279 21071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:28.035701 21042 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 07:02:28.035878 21042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "80e6b7b26dbe4e78a47d955cde8cad8b"
format_stamp: "Formatted at 2026-08-12 07:02:28 on dist-test-slave-tc2s"
server_key: "e3126e85286a68c3659095c4491ff2a6"
server_key_iv: "20d13777efe49f0f6d87fbdef277009d"
server_key_version: "encryptionkey@0"
I20260812 07:02:28.036069 21042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:28.055863 21042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:28.056701 21042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:28.057019 21042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:28.074690 21042 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:45151
I20260812 07:02:28.074709 21173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:45151 every 8 connection(s)
I20260812 07:02:28.075932 21042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:28.077034 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 21042
I20260812 07:02:28.077234 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:28.077800 18714 external_mini_cluster.cc:1428] Setting key c93844af024042e94fbabfee6335d88c
I20260812 07:02:28.080351 21176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:28.091137 21183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:28.079741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55652 (local address 127.18.70.190:45151)
0812 07:02:28.080748 (+ 1007us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:28.080758 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:28.080799 (+ 41us) server_negotiation.cc:407] Connection header received
0812 07:02:28.082458 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:28.082480 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:28.082909 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:28.083246 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:28.083832 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:28.085123 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:28.086955 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:28.087581 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:28.087705 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:28.088929 (+ 1224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:28.088936 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:28.088952 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:28.089470 (+ 518us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:28.089544 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:28.089564 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:28.089652 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:28.089915 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 07:02:28.090219 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":350,"threads_started":1}
I20260812 07:02:28.092715 21176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b: Bootstrap starting.
I20260812 07:02:28.095794 21176 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:28.096741 21176 log.cc:824] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:28.099543 21176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b: No bootstrap required, opened a new log
I20260812 07:02:28.106992 21176 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6b7b26dbe4e78a47d955cde8cad8b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 45151 } }
I20260812 07:02:28.107322 21176 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:28.107414 21176 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80e6b7b26dbe4e78a47d955cde8cad8b, State: Initialized, Role: FOLLOWER
I20260812 07:02:28.107920 21176 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6b7b26dbe4e78a47d955cde8cad8b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 45151 } }
I20260812 07:02:28.108131 21176 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:28.108268 21176 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:28.108420 21176 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:28.110746 21176 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6b7b26dbe4e78a47d955cde8cad8b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 45151 } }
I20260812 07:02:28.111217 21176 leader_election.cc:302] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80e6b7b26dbe4e78a47d955cde8cad8b; no voters:
I20260812 07:02:28.111760 21176 leader_election.cc:288] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:28.111913 21187 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:28.112603 21187 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [term 1 LEADER]: Becoming Leader. State: Replica: 80e6b7b26dbe4e78a47d955cde8cad8b, State: Running, Role: LEADER
I20260812 07:02:28.113085 21187 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6b7b26dbe4e78a47d955cde8cad8b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 45151 } }
I20260812 07:02:28.113610 21176 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:28.115792 21189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80e6b7b26dbe4e78a47d955cde8cad8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6b7b26dbe4e78a47d955cde8cad8b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 45151 } } }
I20260812 07:02:28.116267 21189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:28.115821 21190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80e6b7b26dbe4e78a47d955cde8cad8b. Latest consensus state: current_term: 1 leader_uuid: "80e6b7b26dbe4e78a47d955cde8cad8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e6b7b26dbe4e78a47d955cde8cad8b" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 45151 } } }
I20260812 07:02:28.116498 21190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:28.118300 21193 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:28.123243 21193 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:28.131590 21193 catalog_manager.cc:1347] Generated new cluster ID: 645df953162a4900b07996bfe9323479
I20260812 07:02:28.131696 21193 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:28.144861 21193 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:28.146085 21193 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:28.161562 21193 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b: Generated new TSK 0
I20260812 07:02:28.162353 21193 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:28.174058 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:45151
--builtin_ntp_servers=127.18.70.148:44645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 07:02:28.503013 21214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:28.503265 21214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:28.503381 21214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:28.510298 21214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:28.510391 21214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:28.510528 21214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:02:28.519497 21214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:45151
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:28.520736 21214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:28.522495 21214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:28.534708 21221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:28.534898 21222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:28.535101 21227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:28.535787 21214 server_base.cc:1034] running on GCE node
I20260812 07:02:28.536304 21214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:28.537118 21214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:28.538319 21214 hybrid_clock.cc:648] HybridClock initialized: now 1786518148538271 us; error 38 us; skew 500 ppm
I20260812 07:02:28.538628 21214 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:28.540796 21214 webserver.cc:460] Webserver started at http://127.18.70.129:39823/ using document root <none> and password file <none>
I20260812 07:02:28.541479 21214 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:28.541579 21214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:28.541877 21214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:28.544709 21214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "56da538367ad41c29a04a858621847be"
format_stamp: "Formatted at 2026-08-12 07:02:28 on dist-test-slave-tc2s"
server_key: "3507f4abb6af89e0fe842c685635a27d"
server_key_iv: "ea64edbfb67f87e5345e07fda1248543"
server_key_version: "encryptionkey@0"
I20260812 07:02:28.545485 21214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "56da538367ad41c29a04a858621847be"
format_stamp: "Formatted at 2026-08-12 07:02:28 on dist-test-slave-tc2s"
server_key: "3507f4abb6af89e0fe842c685635a27d"
server_key_iv: "ea64edbfb67f87e5345e07fda1248543"
server_key_version: "encryptionkey@0"
I20260812 07:02:28.550320 21214 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260812 07:02:28.553602 21238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:28.554827 21214 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:02:28.554980 21214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "56da538367ad41c29a04a858621847be"
format_stamp: "Formatted at 2026-08-12 07:02:28 on dist-test-slave-tc2s"
server_key: "3507f4abb6af89e0fe842c685635a27d"
server_key_iv: "ea64edbfb67f87e5345e07fda1248543"
server_key_version: "encryptionkey@0"
I20260812 07:02:28.555172 21214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:28.565876 21214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:28.566619 21214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:28.566882 21214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:28.567799 21214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:28.569119 21214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:28.569213 21214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:28.569325 21214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:28.569396 21214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:28.600001 21214 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:43445
I20260812 07:02:28.600059 21463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:43445 every 8 connection(s)
I20260812 07:02:28.601251 21214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:02:28.603492 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 21214
I20260812 07:02:28.603672 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 07:02:28.604235 18714 external_mini_cluster.cc:1428] Setting key 1f2dde819c85a3cad4ae06427c1f8857
I20260812 07:02:28.606886 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:45151
--builtin_ntp_servers=127.18.70.148:44645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 07:02:28.613373 21469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:28.603671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:52321 (local address 127.18.70.190:45151)
0812 07:02:28.604167 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:28.604173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:28.605317 (+ 1144us) server_negotiation.cc:407] Connection header received
0812 07:02:28.607164 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:28.607168 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:28.607235 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:28.607330 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:28.608374 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:28.609110 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:28.610686 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:28.611111 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:28.611226 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:28.612490 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:28.612495 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:28.612498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:28.612515 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:28.612563 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:28.612576 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:28.612652 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:28.612859 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 07:02:28.613017 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":228,"threads_started":1}
I20260812 07:02:28.614305 21471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:28.604181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:45151 (local address 127.18.70.129:52321)
0812 07:02:28.605165 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:28.605208 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:28.606836 (+ 1628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:28.607584 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:28.607592 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:28.607679 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:28.608204 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:28.608221 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:28.609266 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:28.609270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:28.610541 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:28.610555 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:28.611325 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:28.611334 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:28.611571 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:28.612183 (+ 612us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 07:02:28.612186 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:28.612235 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 07:02:28.612306 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:28.612665 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:28.612676 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:28.612684 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 07:02:28.612840 (+ 156us) client_negotiation.cc:240] Negotiation successful
0812 07:02:28.613190 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":313,"threads_started":1}
I20260812 07:02:28.615793 21464 heartbeater.cc:347] Connected to a master server at 127.18.70.190:45151
I20260812 07:02:28.616076 21464 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:28.616780 21464 heartbeater.cc:511] Master 127.18.70.190:45151 requested a full tablet report, sending...
I20260812 07:02:28.618983 21107 ts_manager.cc:194] Registered new tserver with Master: 56da538367ad41c29a04a858621847be (127.18.70.129:43445)
I20260812 07:02:28.620507 21107 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.129:52321
W20260812 07:02:28.942929 21472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:28.943188 21472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:28.943326 21472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:28.950213 21472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:28.950311 21472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:28.950459 21472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:02:28.959201 21472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:45151
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:28.960353 21472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:28.962054 21472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:28.974453 21481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:28.974334 21482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:28.974398 21484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:28.975193 21472 server_base.cc:1034] running on GCE node
I20260812 07:02:28.975747 21472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:28.976604 21472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:28.977809 21472 hybrid_clock.cc:648] HybridClock initialized: now 1786518148977767 us; error 32 us; skew 500 ppm
I20260812 07:02:28.978137 21472 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:28.980254 21472 webserver.cc:460] Webserver started at http://127.18.70.130:39105/ using document root <none> and password file <none>
I20260812 07:02:28.980913 21472 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:28.981007 21472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:28.981303 21472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:28.984097 21472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "e91605759cb648ae9f8a3bc4b17c6395"
format_stamp: "Formatted at 2026-08-12 07:02:28 on dist-test-slave-tc2s"
server_key: "c7bce194ca77a468df21308955e5e55b"
server_key_iv: "98e36ecb9b38c27dbe701a659a1c1c73"
server_key_version: "encryptionkey@0"
I20260812 07:02:28.984855 21472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "e91605759cb648ae9f8a3bc4b17c6395"
format_stamp: "Formatted at 2026-08-12 07:02:28 on dist-test-slave-tc2s"
server_key: "c7bce194ca77a468df21308955e5e55b"
server_key_iv: "98e36ecb9b38c27dbe701a659a1c1c73"
server_key_version: "encryptionkey@0"
I20260812 07:02:28.989702 21472 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 07:02:28.992889 21495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:28.994100 21472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 07:02:28.994248 21472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "e91605759cb648ae9f8a3bc4b17c6395"
format_stamp: "Formatted at 2026-08-12 07:02:28 on dist-test-slave-tc2s"
server_key: "c7bce194ca77a468df21308955e5e55b"
server_key_iv: "98e36ecb9b38c27dbe701a659a1c1c73"
server_key_version: "encryptionkey@0"
I20260812 07:02:28.994436 21472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:29.015714 21472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:29.016424 21472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:29.016702 21472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:29.017575 21472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:29.019038 21472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:29.019127 21472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:29.019229 21472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:29.019299 21472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:29.049202 21472 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:38705
I20260812 07:02:29.049279 21699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:38705 every 8 connection(s)
I20260812 07:02:29.050539 21472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:02:29.056330 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 21472
I20260812 07:02:29.056507 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 07:02:29.057120 18714 external_mini_cluster.cc:1428] Setting key ed96cbbee05d8e42f50b1aa37fcfcf71
I20260812 07:02:29.060375 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:45151
--builtin_ntp_servers=127.18.70.148:44645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 07:02:29.063616 21469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.052828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:56549 (local address 127.18.70.190:45151)
0812 07:02:29.053049 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.053056 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.054401 (+ 1345us) server_negotiation.cc:407] Connection header received
0812 07:02:29.056152 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.056156 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.056225 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.056309 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:29.057608 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.058543 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.060836 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.061391 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.061486 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.062971 (+ 1485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:29.062976 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:29.062979 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:29.062996 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:29.063028 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:29.063039 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:29.063104 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.063316 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.063392 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 07:02:29.064793 21707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.053295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:45151 (local address 127.18.70.130:56549)
0812 07:02:29.054253 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.054288 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:29.055871 (+ 1583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:29.056571 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:29.056582 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:29.056694 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:29.057439 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.057466 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.058697 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.058701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.060702 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.060717 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.061613 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.061620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.061930 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.062624 (+ 694us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 07:02:29.062628 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:29.062679 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 07:02:29.062772 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:29.063122 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:29.063133 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:29.063140 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 07:02:29.063312 (+ 172us) client_negotiation.cc:240] Negotiation successful
0812 07:02:29.063659 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":326,"threads_started":1}
I20260812 07:02:29.066028 21701 heartbeater.cc:347] Connected to a master server at 127.18.70.190:45151
I20260812 07:02:29.066294 21701 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:29.066969 21701 heartbeater.cc:511] Master 127.18.70.190:45151 requested a full tablet report, sending...
I20260812 07:02:29.068230 21107 ts_manager.cc:194] Registered new tserver with Master: e91605759cb648ae9f8a3bc4b17c6395 (127.18.70.130:38705)
I20260812 07:02:29.069011 21107 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.130:56549
W20260812 07:02:29.384404 21709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:29.384652 21709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:29.384742 21709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:29.391732 21709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:29.391815 21709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:29.391919 21709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:02:29.400538 21709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:45151
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:29.401643 21709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:29.403280 21709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:29.419690 21716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:29.419656 21724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:29.419618 21721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:29.420665 21709 server_base.cc:1034] running on GCE node
I20260812 07:02:29.421192 21709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:29.422071 21709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:29.423259 21709 hybrid_clock.cc:648] HybridClock initialized: now 1786518149423220 us; error 31 us; skew 500 ppm
I20260812 07:02:29.423532 21709 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:29.425601 21709 webserver.cc:460] Webserver started at http://127.18.70.131:41177/ using document root <none> and password file <none>
I20260812 07:02:29.426277 21709 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:29.426370 21709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:29.426676 21709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:29.429674 21709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "bceececadc2a43159daddf4fffb29534"
format_stamp: "Formatted at 2026-08-12 07:02:29 on dist-test-slave-tc2s"
server_key: "c6790eb1790efc83f91f109f55da08d4"
server_key_iv: "d796d689dfcb3de43dbbd4acf3660683"
server_key_version: "encryptionkey@0"
I20260812 07:02:29.430478 21709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "bceececadc2a43159daddf4fffb29534"
format_stamp: "Formatted at 2026-08-12 07:02:29 on dist-test-slave-tc2s"
server_key: "c6790eb1790efc83f91f109f55da08d4"
server_key_iv: "d796d689dfcb3de43dbbd4acf3660683"
server_key_version: "encryptionkey@0"
I20260812 07:02:29.435196 21709 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 07:02:29.438367 21736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:29.439600 21709 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 07:02:29.439746 21709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "bceececadc2a43159daddf4fffb29534"
format_stamp: "Formatted at 2026-08-12 07:02:29 on dist-test-slave-tc2s"
server_key: "c6790eb1790efc83f91f109f55da08d4"
server_key_iv: "d796d689dfcb3de43dbbd4acf3660683"
server_key_version: "encryptionkey@0"
I20260812 07:02:29.439949 21709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:29.457211 21709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:29.457973 21709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:29.458261 21709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:29.459208 21709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:29.460582 21709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:29.460681 21709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:29.460784 21709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:29.460861 21709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:29.490284 21709 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:42503
I20260812 07:02:29.490365 21982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:42503 every 8 connection(s)
I20260812 07:02:29.491503 21709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:02:29.497881 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 21709
I20260812 07:02:29.498087 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 07:02:29.498670 18714 external_mini_cluster.cc:1428] Setting key ec53249b5324d6a9d3353ab57ff022fe
I20260812 07:02:29.503686 21469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.493936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:58863 (local address 127.18.70.190:45151)
0812 07:02:29.494116 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.494121 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.495375 (+ 1254us) server_negotiation.cc:407] Connection header received
0812 07:02:29.497033 (+ 1658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.497037 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.497105 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.497189 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:29.498558 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.499506 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.501386 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.501801 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.501920 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.503049 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:29.503054 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:29.503057 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:29.503074 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:29.503107 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:29.503118 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:29.503184 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.503344 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.503420 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 07:02:29.504475 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.494364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:45151 (local address 127.18.70.131:58863)
0812 07:02:29.495220 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.495259 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:29.496796 (+ 1537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:29.497418 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:29.497425 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:29.497514 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:29.498371 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.498397 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.499673 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.499679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.501246 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.501261 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.502000 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.502006 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.502190 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.502766 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 07:02:29.502768 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:29.502802 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 07:02:29.502882 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:29.503190 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:29.503196 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:29.503200 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 07:02:29.503317 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 07:02:29.503571 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":270,"threads_started":1}
I20260812 07:02:29.505621 21985 heartbeater.cc:347] Connected to a master server at 127.18.70.190:45151
I20260812 07:02:29.505868 21985 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:29.506554 21985 heartbeater.cc:511] Master 127.18.70.190:45151 requested a full tablet report, sending...
I20260812 07:02:29.507777 21107 ts_manager.cc:194] Registered new tserver with Master: bceececadc2a43159daddf4fffb29534 (127.18.70.131:42503)
I20260812 07:02:29.508546 21107 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.131:58863
I20260812 07:02:29.513299 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 07:02:29.523334 21469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.517449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55668 (local address 127.18.70.190:45151)
0812 07:02:29.517582 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.517587 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.518108 (+ 521us) server_negotiation.cc:407] Connection header received
0812 07:02:29.518262 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.518268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.518346 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.518438 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:29.518940 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.519676 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.521019 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.521420 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.521529 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.522644 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:29.522649 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:29.522652 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:29.522668 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:29.522700 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:29.522712 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:29.522841 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.523034 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.523089 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 07:02:29.527046 21107 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55668:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 07:02:29.533636 21107 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 07:02:29.556854 22013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.545539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51010 (local address 127.18.70.130:38705)
0812 07:02:29.546655 (+ 1116us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.546664 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.547753 (+ 1089us) server_negotiation.cc:407] Connection header received
0812 07:02:29.548126 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.548134 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.548369 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.548534 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:29.549599 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.551123 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.553751 (+ 2628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.555279 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.555380 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.555660 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.556292 (+ 632us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.556463 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":955,"thread_start_us":830,"threads_started":1}
I20260812 07:02:29.557648 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.545307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:38705 (local address 127.0.0.1:51010)
0812 07:02:29.547587 (+ 2280us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.547648 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:29.547896 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:29.548913 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:29.548920 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:29.548947 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:29.549389 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.549405 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.551302 (+ 1897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.551308 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.553548 (+ 2240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.553561 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.555820 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.555835 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.556034 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.556086 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 07:02:29.557116 (+ 1030us) client_negotiation.cc:240] Negotiation successful
0812 07:02:29.557304 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2008,"spinlock_wait_cycles":21248,"thread_start_us":2054,"threads_started":1}
I20260812 07:02:29.559432 22010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.545463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:42503 (local address 127.0.0.1:53320)
0812 07:02:29.547626 (+ 2163us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.547647 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:29.547896 (+ 249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:29.549967 (+ 2071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:29.549971 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:29.549999 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:29.550369 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.550382 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.553339 (+ 2957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.553344 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.555494 (+ 2150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.555508 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.558741 (+ 3233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.558747 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.558915 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.558947 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 07:02:29.559028 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 07:02:29.559143 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2032,"thread_start_us":1704,"threads_started":1}
I20260812 07:02:29.559643 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.545970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53320 (local address 127.18.70.131:42503)
0812 07:02:29.547001 (+ 1031us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.547009 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.547753 (+ 744us) server_negotiation.cc:407] Connection header received
0812 07:02:29.548126 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.548134 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.549500 (+ 1366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.549648 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:29.550568 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.553161 (+ 2593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.555709 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.558155 (+ 2446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.558274 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.558608 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.559117 (+ 509us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.559280 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":863,"thread_start_us":688,"threads_started":1}
I20260812 07:02:29.562767 21590 tablet_service.cc:1467] Processing CreateTablet for tablet 41c8b079219a4357a9817332d755ab48 (DEFAULT_TABLE table=test-table [id=49040679bba24cc88dc3cf82ba1ef575]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:29.564286 21590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41c8b079219a4357a9817332d755ab48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:29.565929 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.547930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43445 (local address 127.0.0.1:45666)
0812 07:02:29.557874 (+ 9944us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.557917 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:29.558009 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:29.559471 (+ 1462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:29.559476 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:29.559519 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:29.559692 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.559703 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.561760 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.561765 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.563468 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.563484 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.565237 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.565243 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.565426 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.565457 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 07:02:29.565523 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 07:02:29.565645 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9844,"thread_start_us":10640,"threads_started":1}
I20260812 07:02:29.566895 22018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.548253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45666 (local address 127.18.70.129:43445)
0812 07:02:29.558891 (+ 10638us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.558899 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.558927 (+ 28us) server_negotiation.cc:407] Connection header received
0812 07:02:29.559033 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.559040 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.559265 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.559880 (+ 615us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:29.560158 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.561576 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.563674 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.565056 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.566143 (+ 1087us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.566346 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.566422 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.566565 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10125,"thread_start_us":9995,"threads_started":1}
I20260812 07:02:29.566695 21850 tablet_service.cc:1467] Processing CreateTablet for tablet 41c8b079219a4357a9817332d755ab48 (DEFAULT_TABLE table=test-table [id=49040679bba24cc88dc3cf82ba1ef575]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:29.570175 21850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41c8b079219a4357a9817332d755ab48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:29.569691 21336 tablet_service.cc:1467] Processing CreateTablet for tablet 41c8b079219a4357a9817332d755ab48 (DEFAULT_TABLE table=test-table [id=49040679bba24cc88dc3cf82ba1ef575]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:29.570961 21336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41c8b079219a4357a9817332d755ab48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:29.575912 22023 tablet_bootstrap.cc:492] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395: Bootstrap starting.
I20260812 07:02:29.578655 22023 tablet_bootstrap.cc:654] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:29.579586 22023 log.cc:824] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:29.582965 22023 tablet_bootstrap.cc:492] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395: No bootstrap required, opened a new log
I20260812 07:02:29.583226 22023 ts_tablet_manager.cc:1397] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 07:02:29.584712 22029 tablet_bootstrap.cc:492] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be: Bootstrap starting.
I20260812 07:02:29.588042 22029 tablet_bootstrap.cc:654] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:29.588814 22030 tablet_bootstrap.cc:492] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534: Bootstrap starting.
I20260812 07:02:29.589164 22029 log.cc:824] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:29.591974 22029 tablet_bootstrap.cc:492] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be: No bootstrap required, opened a new log
I20260812 07:02:29.592023 22030 tablet_bootstrap.cc:654] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:29.592222 22029 ts_tablet_manager.cc:1397] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 07:02:29.592600 22023 raft_consensus.cc:348] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91605759cb648ae9f8a3bc4b17c6395" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38705 } } peers { permanent_uuid: "bceececadc2a43159daddf4fffb29534" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42503 } } peers { permanent_uuid: "56da538367ad41c29a04a858621847be" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43445 } }
I20260812 07:02:29.592904 22030 log.cc:824] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:29.593040 22023 raft_consensus.cc:374] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:29.593146 22023 raft_consensus.cc:729] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e91605759cb648ae9f8a3bc4b17c6395, State: Initialized, Role: FOLLOWER
I20260812 07:02:29.593745 22023 consensus_queue.cc:260] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91605759cb648ae9f8a3bc4b17c6395" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38705 } } peers { permanent_uuid: "bceececadc2a43159daddf4fffb29534" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42503 } } peers { permanent_uuid: "56da538367ad41c29a04a858621847be" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43445 } }
I20260812 07:02:29.595139 21701 heartbeater.cc:503] Master 127.18.70.190:45151 was elected leader, sending a full tablet report...
I20260812 07:02:29.595685 22023 ts_tablet_manager.cc:1428] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260812 07:02:29.595970 22030 tablet_bootstrap.cc:492] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534: No bootstrap required, opened a new log
I20260812 07:02:29.596268 22030 ts_tablet_manager.cc:1397] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 07:02:29.601394 22029 raft_consensus.cc:348] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91605759cb648ae9f8a3bc4b17c6395" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38705 } } peers { permanent_uuid: "bceececadc2a43159daddf4fffb29534" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42503 } } peers { permanent_uuid: "56da538367ad41c29a04a858621847be" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43445 } }
I20260812 07:02:29.601727 22029 raft_consensus.cc:374] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:29.601826 22029 raft_consensus.cc:729] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56da538367ad41c29a04a858621847be, State: Initialized, Role: FOLLOWER
I20260812 07:02:29.602392 22029 consensus_queue.cc:260] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91605759cb648ae9f8a3bc4b17c6395" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38705 } } peers { permanent_uuid: "bceececadc2a43159daddf4fffb29534" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42503 } } peers { permanent_uuid: "56da538367ad41c29a04a858621847be" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43445 } }
I20260812 07:02:29.603381 21464 heartbeater.cc:503] Master 127.18.70.190:45151 was elected leader, sending a full tablet report...
I20260812 07:02:29.603982 22029 ts_tablet_manager.cc:1428] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260812 07:02:29.605809 22030 raft_consensus.cc:348] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91605759cb648ae9f8a3bc4b17c6395" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38705 } } peers { permanent_uuid: "bceececadc2a43159daddf4fffb29534" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42503 } } peers { permanent_uuid: "56da538367ad41c29a04a858621847be" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43445 } }
I20260812 07:02:29.606186 22030 raft_consensus.cc:374] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:29.606284 22030 raft_consensus.cc:729] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bceececadc2a43159daddf4fffb29534, State: Initialized, Role: FOLLOWER
I20260812 07:02:29.606953 22030 consensus_queue.cc:260] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91605759cb648ae9f8a3bc4b17c6395" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38705 } } peers { permanent_uuid: "bceececadc2a43159daddf4fffb29534" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42503 } } peers { permanent_uuid: "56da538367ad41c29a04a858621847be" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43445 } }
I20260812 07:02:29.608215 21985 heartbeater.cc:503] Master 127.18.70.190:45151 was elected leader, sending a full tablet report...
I20260812 07:02:29.608337 22039 raft_consensus.cc:482] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:02:29.608575 22039 raft_consensus.cc:504] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91605759cb648ae9f8a3bc4b17c6395" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38705 } } peers { permanent_uuid: "bceececadc2a43159daddf4fffb29534" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42503 } } peers { permanent_uuid: "56da538367ad41c29a04a858621847be" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43445 } }
I20260812 07:02:29.609124 22030 ts_tablet_manager.cc:1428] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260812 07:02:29.615666 22039 leader_election.cc:288] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e91605759cb648ae9f8a3bc4b17c6395 (127.18.70.130:38705), 56da538367ad41c29a04a858621847be (127.18.70.129:43445)
I20260812 07:02:29.618175 22013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.611518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:40701 (local address 127.18.70.130:38705)
0812 07:02:29.611671 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.611677 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.611698 (+ 21us) server_negotiation.cc:407] Connection header received
0812 07:02:29.611759 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.611765 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.611846 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.611951 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:29.613178 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.614253 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.616485 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.617399 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.617531 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.617590 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.617879 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.618004 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 07:02:29.618275 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.611358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:38705 (local address 127.18.70.131:40701)
0812 07:02:29.611520 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.611541 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:29.611645 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:29.612767 (+ 1122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:29.612772 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:29.612806 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:29.613008 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.613020 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.614410 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.614416 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.616329 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.616344 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.617533 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.617539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.617728 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.617763 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 07:02:29.617853 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 07:02:29.618026 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 07:02:29.619279 21623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41c8b079219a4357a9817332d755ab48" candidate_uuid: "bceececadc2a43159daddf4fffb29534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91605759cb648ae9f8a3bc4b17c6395" is_pre_election: true
I20260812 07:02:29.619812 21623 raft_consensus.cc:2454] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bceececadc2a43159daddf4fffb29534 in term 0.
I20260812 07:02:29.620436 21742 leader_election.cc:302] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bceececadc2a43159daddf4fffb29534, e91605759cb648ae9f8a3bc4b17c6395; no voters:
I20260812 07:02:29.620743 22039 raft_consensus.cc:2781] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:02:29.620889 22039 raft_consensus.cc:482] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:02:29.620993 22039 raft_consensus.cc:3037] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:29.622144 22044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.611850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43445 (local address 127.18.70.131:35165)
0812 07:02:29.616259 (+ 4409us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.616286 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:29.616416 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:29.616703 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:29.616708 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:29.616730 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:29.617111 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.617123 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.618347 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.618353 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.620173 (+ 1820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:29.620188 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.621574 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.621579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:29.621695 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.621720 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 07:02:29.621795 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 07:02:29.621883 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4282,"thread_start_us":4131,"threads_started":1}
I20260812 07:02:29.622205 22018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.611935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:35165 (local address 127.18.70.129:43445)
0812 07:02:29.612497 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.612503 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.616388 (+ 3885us) server_negotiation.cc:407] Connection header received
0812 07:02:29.616527 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.616532 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.616599 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.616668 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:29.617254 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.618177 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.620362 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.621422 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.621568 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.621630 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.621828 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.621977 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431}
I20260812 07:02:29.622957 21375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41c8b079219a4357a9817332d755ab48" candidate_uuid: "bceececadc2a43159daddf4fffb29534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56da538367ad41c29a04a858621847be" is_pre_election: true
I20260812 07:02:29.623449 21375 raft_consensus.cc:2454] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bceececadc2a43159daddf4fffb29534 in term 0.
I20260812 07:02:29.624209 22039 raft_consensus.cc:504] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91605759cb648ae9f8a3bc4b17c6395" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38705 } } peers { permanent_uuid: "bceececadc2a43159daddf4fffb29534" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42503 } } peers { permanent_uuid: "56da538367ad41c29a04a858621847be" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43445 } }
I20260812 07:02:29.624722 22039 leader_election.cc:288] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [CANDIDATE]: Term 1 election: Requested vote from peers e91605759cb648ae9f8a3bc4b17c6395 (127.18.70.130:38705), 56da538367ad41c29a04a858621847be (127.18.70.129:43445)
I20260812 07:02:29.625061 21623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41c8b079219a4357a9817332d755ab48" candidate_uuid: "bceececadc2a43159daddf4fffb29534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e91605759cb648ae9f8a3bc4b17c6395"
I20260812 07:02:29.625109 21375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41c8b079219a4357a9817332d755ab48" candidate_uuid: "bceececadc2a43159daddf4fffb29534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56da538367ad41c29a04a858621847be"
I20260812 07:02:29.625226 21623 raft_consensus.cc:3037] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:29.625249 21375 raft_consensus.cc:3037] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:29.627365 21375 raft_consensus.cc:2454] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bceececadc2a43159daddf4fffb29534 in term 1.
I20260812 07:02:29.627385 21623 raft_consensus.cc:2454] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bceececadc2a43159daddf4fffb29534 in term 1.
I20260812 07:02:29.627691 21742 leader_election.cc:302] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56da538367ad41c29a04a858621847be, bceececadc2a43159daddf4fffb29534; no voters:
I20260812 07:02:29.627940 22039 raft_consensus.cc:2781] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:29.628089 22039 raft_consensus.cc:686] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 1 LEADER]: Becoming Leader. State: Replica: bceececadc2a43159daddf4fffb29534, State: Running, Role: LEADER
I20260812 07:02:29.628491 22039 consensus_queue.cc:237] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91605759cb648ae9f8a3bc4b17c6395" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38705 } } peers { permanent_uuid: "bceececadc2a43159daddf4fffb29534" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42503 } } peers { permanent_uuid: "56da538367ad41c29a04a858621847be" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43445 } }
I20260812 07:02:29.632146 21107 catalog_manager.cc:5495] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 reported cstate change: term changed from 0 to 1, leader changed from <none> to bceececadc2a43159daddf4fffb29534 (127.18.70.131). New cstate: current_term: 1 leader_uuid: "bceececadc2a43159daddf4fffb29534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e91605759cb648ae9f8a3bc4b17c6395" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bceececadc2a43159daddf4fffb29534" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56da538367ad41c29a04a858621847be" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43445 } health_report { overall_health: UNKNOWN } } }
I20260812 07:02:29.654296 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.648825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53330 (local address 127.18.70.131:42503)
0812 07:02:29.649013 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.649019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.649157 (+ 138us) server_negotiation.cc:407] Connection header received
0812 07:02:29.649360 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.649364 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.649446 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.649571 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:02:29.649985 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.650688 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.652134 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.652526 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.652641 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.653237 (+ 596us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:02:29.653701 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:02:29.653858 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.654054 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.654095 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 07:02:29.661701 21375 raft_consensus.cc:1261] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be [term 1 FOLLOWER]: Refusing update from remote peer bceececadc2a43159daddf4fffb29534: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:29.661767 21623 raft_consensus.cc:1261] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395 [term 1 FOLLOWER]: Refusing update from remote peer bceececadc2a43159daddf4fffb29534: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:29.662618 22038 consensus_queue.cc:1035] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e91605759cb648ae9f8a3bc4b17c6395" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 38705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:29.662945 22039 consensus_queue.cc:1035] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56da538367ad41c29a04a858621847be" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 43445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:29.672943 22051 mvcc.cc:205] Tried to move back new op lower bound from 7317578341005688832 to 7317578340881330176. Current Snapshot: MvccSnapshot[applied={T|T < 7317578341005688832}]
I20260812 07:02:29.685182 21105 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55668:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:29.685424 21105 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55668:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:29.688870 21105 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 80e6b7b26dbe4e78a47d955cde8cad8b: Sending DeleteTablet for 3 replicas of tablet 41c8b079219a4357a9817332d755ab48
I20260812 07:02:29.689956 21850 tablet_service.cc:1514] Processing DeleteTablet for tablet 41c8b079219a4357a9817332d755ab48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:29 UTC) from {username='slave'} at 127.0.0.1:53320
I20260812 07:02:29.689982 21590 tablet_service.cc:1514] Processing DeleteTablet for tablet 41c8b079219a4357a9817332d755ab48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:29 UTC) from {username='slave'} at 127.0.0.1:51010
I20260812 07:02:29.690618 21336 tablet_service.cc:1514] Processing DeleteTablet for tablet 41c8b079219a4357a9817332d755ab48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:29 UTC) from {username='slave'} at 127.0.0.1:45666
I20260812 07:02:29.691308 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 21214
I20260812 07:02:29.691383 22074 tablet_replica.cc:330] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534: stopping tablet replica
I20260812 07:02:29.691776 22074 raft_consensus.cc:2229] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 1 LEADER]: Raft consensus shutting down.
I20260812 07:02:29.692428 22074 raft_consensus.cc:2258] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:29.694634 22074 ts_tablet_manager.cc:1905] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:29.702669 22074 ts_tablet_manager.cc:1918] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:29.702908 22074 log.cc:1196] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/41c8b079219a4357a9817332d755ab48
I20260812 07:02:29.703562 22074 ts_tablet_manager.cc:1939] T 41c8b079219a4357a9817332d755ab48 P bceececadc2a43159daddf4fffb29534: Deleting consensus metadata
I20260812 07:02:29.705250 22075 tablet_replica.cc:330] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be: stopping tablet replica
I20260812 07:02:29.705328 21073 catalog_manager.cc:4841] TS bceececadc2a43159daddf4fffb29534 (127.18.70.131:42503): tablet 41c8b079219a4357a9817332d755ab48 (table test-table [id=49040679bba24cc88dc3cf82ba1ef575]) successfully deleted
I20260812 07:02:29.705811 22075 raft_consensus.cc:2229] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:02:29.706406 22075 raft_consensus.cc:2258] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:29.708402 22075 ts_tablet_manager.cc:1905] T 41c8b079219a4357a9817332d755ab48 P 56da538367ad41c29a04a858621847be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:29.708842 22065 tablet_replica.cc:330] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395: stopping tablet replica
I20260812 07:02:29.709257 22065 raft_consensus.cc:2229] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:02:29.709761 22065 raft_consensus.cc:2258] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:29.711628 22065 ts_tablet_manager.cc:1905] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:29.712419 22018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.692655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45670 (local address 127.18.70.129:43445)
0812 07:02:29.692824 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.692830 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.703441 (+ 10611us) server_negotiation.cc:407] Connection header received
0812 07:02:29.703893 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.703899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.704006 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.704090 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:29.705662 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.706862 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.708687 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.709313 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.709405 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.710794 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:29.710805 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:29.710820 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:29.711537 (+ 717us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:29.711598 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:29.711627 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:29.711711 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.711937 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.712052 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 07:02:29.713716 21455 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:29.720045 22065 ts_tablet_manager.cc:1918] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:29.720196 22065 log.cc:1196] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/41c8b079219a4357a9817332d755ab48
I20260812 07:02:29.720752 22065 ts_tablet_manager.cc:1939] T 41c8b079219a4357a9817332d755ab48 P e91605759cb648ae9f8a3bc4b17c6395: Deleting consensus metadata
I20260812 07:02:29.722470 21078 catalog_manager.cc:4841] TS e91605759cb648ae9f8a3bc4b17c6395 (127.18.70.130:38705): tablet 41c8b079219a4357a9817332d755ab48 (table test-table [id=49040679bba24cc88dc3cf82ba1ef575]) successfully deleted
I20260812 07:02:29.803154 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 21214
W20260812 07:02:29.831766 21078 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.70.129:43445 (error 108)
I20260812 07:02:29.832021 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 21472
I20260812 07:02:29.833931 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.833361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43445 (local address 127.0.0.1:45674)
0812 07:02:29.833594 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.833713 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260812 07:02:29.834201 21078 catalog_manager.cc:4584] TS 56da538367ad41c29a04a858621847be (127.18.70.129:43445): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 41c8b079219a4357a9817332d755ab48: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43445: connect: Connection refused (error 111)
I20260812 07:02:29.839004 22013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.832910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51018 (local address 127.18.70.130:38705)
0812 07:02:29.833109 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.833114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.833133 (+ 19us) server_negotiation.cc:407] Connection header received
0812 07:02:29.833287 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.833293 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.833424 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.833556 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:29.834004 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.834806 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.836067 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.836466 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.836585 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.837597 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:29.837607 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:29.837621 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:29.838282 (+ 661us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:29.838330 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:29.838351 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:29.838460 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.838593 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.838704 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 07:02:29.839790 21690 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:29.888051 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.887496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43445 (local address 127.0.0.1:45682)
0812 07:02:29.887746 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.887864 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 07:02:29.889238 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.888825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43445 (local address 127.0.0.1:45684)
0812 07:02:29.888984 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.889073 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 07:02:29.927645 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 21472
I20260812 07:02:29.950392 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.949907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43445 (local address 127.0.0.1:45690)
0812 07:02:29.950089 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.950190 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 07:02:29.951874 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.951533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43445 (local address 127.0.0.1:45698)
0812 07:02:29.951657 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:29.951727 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 07:02:29.963843 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 21709
I20260812 07:02:29.974900 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:29.966329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.18.70.131:42503)
0812 07:02:29.966550 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:29.966556 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:29.966579 (+ 23us) server_negotiation.cc:407] Connection header received
0812 07:02:29.966805 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:29.966812 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:29.966939 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:29.967045 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:29.967610 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.968823 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.970892 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:29.971753 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:29.971909 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:29.973044 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:29.973056 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:29.973089 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:29.974004 (+ 915us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:29.974068 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:29.974095 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:29.974206 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:29.974385 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 07:02:29.974503 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 07:02:29.975586 21967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:30.032819 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:30.032365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43445 (local address 127.0.0.1:45702)
0812 07:02:30.032578 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:30.032669 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 07:02:30.033881 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:30.033461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43445 (local address 127.0.0.1:45712)
0812 07:02:30.033664 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:30.033737 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260812 07:02:30.096284 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 21709
I20260812 07:02:30.124480 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 21042
I20260812 07:02:30.125479 21166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:30.232355 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:30.231794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:43445 (local address 127.0.0.1:45726)
0812 07:02:30.232089 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:30.232190 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260812 07:02:30.232371 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 21042
2026-08-12T07:02:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2659 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:30 dist-test-slave-tc2s krb5kdc[22094](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:30 dist-test-slave-tc2s krb5kdc[22094](info): set up 2 sockets
Aug 12 07:02:30 dist-test-slave-tc2s krb5kdc[22094](info): commencing operation
krb5kdc: starting...
W20260812 07:02:31.489116 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.211s user 0.007s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:31 dist-test-slave-tc2s krb5kdc[22094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:02:31.732678 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43125
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:43125
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:32.054399 22121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:32.054666 22121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:32.054802 22121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:32.061853 22121 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:32.061973 22121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:32.062057 22121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:32.062137 22121 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:32.062198 22121 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:32.071622 22121 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:43125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:32.072773 22121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:32.074056 22121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:32.085220 22127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:32.085132 22129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:32.085162 22132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:32.085814 22121 server_base.cc:1034] running on GCE node
I20260812 07:02:32.086544 22121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:32.087783 22121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:32.088991 22121 hybrid_clock.cc:648] HybridClock initialized: now 1786518152088943 us; error 35 us; skew 500 ppm
I20260812 07:02:32.089300 22121 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:32 dist-test-slave-tc2s krb5kdc[22094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518152, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:32.096835 22121 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:02:32.098327 22121 webserver.cc:460] Webserver started at http://127.18.70.190:38777/ using document root <none> and password file <none>
I20260812 07:02:32.098970 22121 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:32.099093 22121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:32.099383 22121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:32.102370 22121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "dbd00689200345318571c5d03bdea59d"
format_stamp: "Formatted at 2026-08-12 07:02:32 on dist-test-slave-tc2s"
server_key: "43fc025804beaa334312ea1965d62d98"
server_key_iv: "b6f700f41b07ae1b34fae66b0c2933ae"
server_key_version: "encryptionkey@0"
I20260812 07:02:32.103108 22121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "dbd00689200345318571c5d03bdea59d"
format_stamp: "Formatted at 2026-08-12 07:02:32 on dist-test-slave-tc2s"
server_key: "43fc025804beaa334312ea1965d62d98"
server_key_iv: "b6f700f41b07ae1b34fae66b0c2933ae"
server_key_version: "encryptionkey@0"
I20260812 07:02:32.107985 22121 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 07:02:32.111181 22146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:32.112360 22121 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.004s
I20260812 07:02:32.112500 22121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "dbd00689200345318571c5d03bdea59d"
format_stamp: "Formatted at 2026-08-12 07:02:32 on dist-test-slave-tc2s"
server_key: "43fc025804beaa334312ea1965d62d98"
server_key_iv: "b6f700f41b07ae1b34fae66b0c2933ae"
server_key_version: "encryptionkey@0"
I20260812 07:02:32.112669 22121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:32.130517 22121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:32.134259 22121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:32.134496 22121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:32.151630 22121 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:43125
I20260812 07:02:32.151660 22246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:43125 every 8 connection(s)
I20260812 07:02:32.152813 22121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:32.156224 22248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:32.162978 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 22121
I20260812 07:02:32.163182 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:32.163730 18714 external_mini_cluster.cc:1428] Setting key 69d628722e9480196938c0334ffc07b2
I20260812 07:02:32.166713 22248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d: Bootstrap starting.
I20260812 07:02:32.169974 22248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:32.171093 22248 log.cc:824] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:32.174158 22248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d: No bootstrap required, opened a new log
Aug 12 07:02:32 dist-test-slave-tc2s krb5kdc[22094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:32.183230 22248 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd00689200345318571c5d03bdea59d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43125 } }
I20260812 07:02:32.183663 22248 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:32.183768 22248 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd00689200345318571c5d03bdea59d, State: Initialized, Role: FOLLOWER
I20260812 07:02:32.184381 22248 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd00689200345318571c5d03bdea59d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43125 } }
I20260812 07:02:32.184620 22248 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:32.184763 22248 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:32.184919 22248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:32.186910 22261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:32.165461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33354 (local address 127.18.70.190:43125)
0812 07:02:32.166199 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:32.166210 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:32.166248 (+ 38us) server_negotiation.cc:407] Connection header received
0812 07:02:32.167952 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:32.167973 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:32.168315 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:32.168605 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:32.170524 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:32.172031 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:32.173816 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:32.174521 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:32.174658 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:32.179597 (+ 4939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:32.179606 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:32.179622 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:32.179661 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:32.182665 (+ 3004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:32.183549 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:32.183557 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:32.183562 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:32.183779 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:32.184226 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:32.184230 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:32.184232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:32.184789 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:32.185097 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:32.185551 (+ 454us) server_negotiation.cc:299] Negotiation successful
0812 07:02:32.185993 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":358,"threads_started":1}
I20260812 07:02:32.187276 22248 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd00689200345318571c5d03bdea59d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43125 } }
I20260812 07:02:32.187752 22248 leader_election.cc:302] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbd00689200345318571c5d03bdea59d; no voters:
I20260812 07:02:32.188365 22248 leader_election.cc:288] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:32.188495 22271 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:32.189553 22271 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [term 1 LEADER]: Becoming Leader. State: Replica: dbd00689200345318571c5d03bdea59d, State: Running, Role: LEADER
I20260812 07:02:32.190179 22271 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd00689200345318571c5d03bdea59d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43125 } }
I20260812 07:02:32.190563 22248 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:32.193563 22273 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbd00689200345318571c5d03bdea59d. Latest consensus state: current_term: 1 leader_uuid: "dbd00689200345318571c5d03bdea59d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd00689200345318571c5d03bdea59d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43125 } } }
I20260812 07:02:32.193634 22272 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbd00689200345318571c5d03bdea59d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd00689200345318571c5d03bdea59d" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43125 } } }
I20260812 07:02:32.193967 22273 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:32.194005 22272 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:32.198629 22282 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:32.203182 22282 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:32.210953 22282 catalog_manager.cc:1347] Generated new cluster ID: b263b35915ba4b3d9dab3dfa2a176841
I20260812 07:02:32.211063 22282 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:32.225246 22282 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:32.226960 22282 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:32.233700 22282 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d: Generated new TSK 0
I20260812 07:02:32.234591 22282 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.70.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
Entry for principal kudu/127.18.70.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab.
I20260812 07:02:32.295166 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43125
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:32.634019 22301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:32.634291 22301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:32.634394 22301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:32.641690 22301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:32.641810 22301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:32.641955 22301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:02:32.651798 22301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.129.keytab
--principal=kudu/127.18.70.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:32.653029 22301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:32.654285 22301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:32.666723 22313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:32.666661 22315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:32.666761 22317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:32.667595 22301 server_base.cc:1034] running on GCE node
I20260812 07:02:32.668141 22301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:32.668989 22301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:32.670192 22301 hybrid_clock.cc:648] HybridClock initialized: now 1786518152670142 us; error 34 us; skew 500 ppm
I20260812 07:02:32.670483 22301 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:32 dist-test-slave-tc2s krb5kdc[22094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518152, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:32.673465 22301 init.cc:377] Logged in from keytab as kudu/127.18.70.129@KRBTEST.COM (short username kudu)
I20260812 07:02:32.674814 22301 webserver.cc:460] Webserver started at http://127.18.70.129:40379/ using document root <none> and password file <none>
I20260812 07:02:32.675436 22301 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:32.675552 22301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:32.675832 22301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:32.678670 22301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "02b5590c7f564107b196b1c987afce88"
format_stamp: "Formatted at 2026-08-12 07:02:32 on dist-test-slave-tc2s"
server_key: "0204f82a18c96f4f3958fded46ab34fb"
server_key_iv: "19746d73889d0bb98b032d1e1b166479"
server_key_version: "encryptionkey@0"
I20260812 07:02:32.679402 22301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "02b5590c7f564107b196b1c987afce88"
format_stamp: "Formatted at 2026-08-12 07:02:32 on dist-test-slave-tc2s"
server_key: "0204f82a18c96f4f3958fded46ab34fb"
server_key_iv: "19746d73889d0bb98b032d1e1b166479"
server_key_version: "encryptionkey@0"
I20260812 07:02:32.684104 22301 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 07:02:32.687611 22330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:32.688807 22301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 07:02:32.688966 22301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "02b5590c7f564107b196b1c987afce88"
format_stamp: "Formatted at 2026-08-12 07:02:32 on dist-test-slave-tc2s"
server_key: "0204f82a18c96f4f3958fded46ab34fb"
server_key_iv: "19746d73889d0bb98b032d1e1b166479"
server_key_version: "encryptionkey@0"
I20260812 07:02:32.689126 22301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:32.730299 22301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:32.733922 22301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:32.734182 22301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:32.735023 22301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:32.736268 22301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:32.736339 22301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:32.736443 22301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:32.736493 22301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:32.768832 22301 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:36663
I20260812 07:02:32.768888 22539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:36663 every 8 connection(s)
I20260812 07:02:32.770004 22301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:02:32.775252 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 22301
I20260812 07:02:32.775437 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 07:02:32.775853 18714 external_mini_cluster.cc:1428] Setting key 282ed20032e345651372d7c76c811ed1
Aug 12 07:02:32 dist-test-slave-tc2s krb5kdc[22094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518152, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.129@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:32.788439 22542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:32.772351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:48317 (local address 127.18.70.190:43125)
0812 07:02:32.772797 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:32.772803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:32.773674 (+ 871us) server_negotiation.cc:407] Connection header received
0812 07:02:32.775502 (+ 1828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:32.775509 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:32.775589 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:32.775681 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:32.777250 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:32.778102 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:32.779577 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:32.779968 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:32.780079 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:32.783257 (+ 3178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:32.783262 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:32.783266 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:32.783297 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:32.785569 (+ 2272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:32.786265 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:32.786271 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:32.786273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:32.786404 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:32.786799 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:32.786802 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:32.786804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:32.787059 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:32.787192 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:32.787830 (+ 638us) server_negotiation.cc:299] Negotiation successful
0812 07:02:32.788073 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":223,"threads_started":1}
I20260812 07:02:32.789240 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:32.772844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43125 (local address 127.18.70.129:48317)
0812 07:02:32.773508 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:32.773546 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:32.775202 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:32.775937 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:32.775947 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:32.776440 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:32.777079 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:32.777098 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:32.778246 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:32.778250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:32.779435 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:32.779448 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:32.780178 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:32.780186 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:32.780415 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:32.781006 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:02:32.781027 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:32.783062 (+ 2035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:32.785693 (+ 2631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:32.785701 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:32.785715 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:32.786155 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:32.786508 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:32.786513 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:32.786516 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:32.786682 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:32.787182 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:32.787189 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:32.787462 (+ 273us) client_negotiation.cc:769] Sending connection context
0812 07:02:32.787684 (+ 222us) client_negotiation.cc:240] Negotiation successful
0812 07:02:32.788142 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":256,"threads_started":1}
I20260812 07:02:32.790846 22540 heartbeater.cc:347] Connected to a master server at 127.18.70.190:43125
I20260812 07:02:32.791127 22540 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:32.791986 22540 heartbeater.cc:511] Master 127.18.70.190:43125 requested a full tablet report, sending...
I20260812 07:02:32.794330 22176 ts_manager.cc:194] Registered new tserver with Master: 02b5590c7f564107b196b1c987afce88 (127.18.70.129:36663)
I20260812 07:02:32.796281 22176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.129@KRBTEST.COM'} at 127.18.70.129:48317
WARNING: no policy specified for kudu/127.18.70.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
Entry for principal kudu/127.18.70.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab.
I20260812 07:02:32.834844 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43125
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:33.153275 22550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:33.153506 22550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:33.153618 22550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:33.160583 22550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:33.160674 22550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:33.160822 22550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:02:33.170013 22550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.130.keytab
--principal=kudu/127.18.70.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:33.171090 22550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:33.172235 22550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:33.184310 22560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:33.184415 22565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:33.184368 22562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:33.185299 22550 server_base.cc:1034] running on GCE node
I20260812 07:02:33.185797 22550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:33.186658 22550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:33.187867 22550 hybrid_clock.cc:648] HybridClock initialized: now 1786518153187814 us; error 45 us; skew 500 ppm
I20260812 07:02:33.188120 22550 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:33 dist-test-slave-tc2s krb5kdc[22094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518153, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:33.191077 22550 init.cc:377] Logged in from keytab as kudu/127.18.70.130@KRBTEST.COM (short username kudu)
I20260812 07:02:33.192505 22550 webserver.cc:460] Webserver started at http://127.18.70.130:36289/ using document root <none> and password file <none>
I20260812 07:02:33.193150 22550 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:33.193265 22550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:33.193557 22550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:33.196798 22550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "a347d4131286491db56b43ab6d346086"
format_stamp: "Formatted at 2026-08-12 07:02:33 on dist-test-slave-tc2s"
server_key: "bc1e406a4ba87a823c29bb5dd38a1dc8"
server_key_iv: "11684d33eb8f5c271367a262d17f129f"
server_key_version: "encryptionkey@0"
I20260812 07:02:33.197873 22550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "a347d4131286491db56b43ab6d346086"
format_stamp: "Formatted at 2026-08-12 07:02:33 on dist-test-slave-tc2s"
server_key: "bc1e406a4ba87a823c29bb5dd38a1dc8"
server_key_iv: "11684d33eb8f5c271367a262d17f129f"
server_key_version: "encryptionkey@0"
I20260812 07:02:33.203356 22550 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 07:02:33.206732 22580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:33.207876 22550 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 07:02:33.208029 22550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "a347d4131286491db56b43ab6d346086"
format_stamp: "Formatted at 2026-08-12 07:02:33 on dist-test-slave-tc2s"
server_key: "bc1e406a4ba87a823c29bb5dd38a1dc8"
server_key_iv: "11684d33eb8f5c271367a262d17f129f"
server_key_version: "encryptionkey@0"
I20260812 07:02:33.208202 22550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:33.227350 22550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:33.230823 22550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:33.231078 22550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:33.232144 22550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:33.233398 22550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:33.233469 22550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:33.233587 22550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:33.233635 22550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:33.263697 22550 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:46277
I20260812 07:02:33.263754 22802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:46277 every 8 connection(s)
I20260812 07:02:33.264858 22550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:02:33.266418 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 22550
I20260812 07:02:33.266580 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 07:02:33.267191 18714 external_mini_cluster.cc:1428] Setting key 96346a40618250a816039177f9a037e2
Aug 12 07:02:33 dist-test-slave-tc2s krb5kdc[22094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518153, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.130@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:33.286010 22542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:33.267286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:36283 (local address 127.18.70.190:43125)
0812 07:02:33.267452 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:33.267457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:33.268816 (+ 1359us) server_negotiation.cc:407] Connection header received
0812 07:02:33.271218 (+ 2402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:33.271223 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:33.271294 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:33.271374 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:33.273109 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.273803 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.275775 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.276233 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.276336 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:33.280206 (+ 3870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:33.280212 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:33.280217 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:33.280253 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:33.283096 (+ 2843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:33.283785 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:33.283790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:33.283792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:33.283925 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:33.284340 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:33.284343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:33.284345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:33.284615 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:33.284747 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:33.285404 (+ 657us) server_negotiation.cc:299] Negotiation successful
0812 07:02:33.285633 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 07:02:33.286862 22810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:33.267877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43125 (local address 127.18.70.130:36283)
0812 07:02:33.268647 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:33.268692 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:33.270926 (+ 2234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:33.271608 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:33.271617 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:33.272271 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:33.272940 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:33.272975 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.273979 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.273984 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:33.275640 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:33.275654 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.276446 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.276453 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:33.276698 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:33.277352 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:02:33.277385 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:33.279986 (+ 2601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:33.283228 (+ 3242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:33.283237 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:33.283247 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:33.283658 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:33.284043 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:33.284047 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:33.284049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:33.284225 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:33.284740 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:33.284748 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:33.285046 (+ 298us) client_negotiation.cc:769] Sending connection context
0812 07:02:33.285269 (+ 223us) client_negotiation.cc:240] Negotiation successful
0812 07:02:33.285757 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":311,"threads_started":1}
I20260812 07:02:33.288270 22805 heartbeater.cc:347] Connected to a master server at 127.18.70.190:43125
I20260812 07:02:33.288538 22805 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:33.289196 22805 heartbeater.cc:511] Master 127.18.70.190:43125 requested a full tablet report, sending...
I20260812 07:02:33.290699 22176 ts_manager.cc:194] Registered new tserver with Master: a347d4131286491db56b43ab6d346086 (127.18.70.130:46277)
I20260812 07:02:33.291525 22176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.130@KRBTEST.COM'} at 127.18.70.130:36283
WARNING: no policy specified for kudu/127.18.70.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
Entry for principal kudu/127.18.70.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab.
I20260812 07:02:33.328522 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43125
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:37033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:33.651736 22814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:33.651994 22814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:33.652127 22814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:33.659088 22814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:33.659178 22814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:33.659322 22814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:02:33.668612 22814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:37033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.131.keytab
--principal=kudu/127.18.70.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:43125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:33.669745 22814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:33.670974 22814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:33.683017 22822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:33.683213 22821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:33.683573 22827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:33.684672 22814 server_base.cc:1034] running on GCE node
I20260812 07:02:33.685209 22814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:33.686043 22814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:33.687234 22814 hybrid_clock.cc:648] HybridClock initialized: now 1786518153687187 us; error 41 us; skew 500 ppm
I20260812 07:02:33.687510 22814 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:33 dist-test-slave-tc2s krb5kdc[22094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518153, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:33.690402 22814 init.cc:377] Logged in from keytab as kudu/127.18.70.131@KRBTEST.COM (short username kudu)
I20260812 07:02:33.691758 22814 webserver.cc:460] Webserver started at http://127.18.70.131:39403/ using document root <none> and password file <none>
I20260812 07:02:33.692456 22814 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:33.692572 22814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:33.692857 22814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:33.695767 22814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "254a16c101dd48eb8afe38e3393c3dca"
format_stamp: "Formatted at 2026-08-12 07:02:33 on dist-test-slave-tc2s"
server_key: "f649a7c099f395101f74869a0e3ca4c1"
server_key_iv: "219fcbf0df2824309ee3d075fa41b0c1"
server_key_version: "encryptionkey@0"
I20260812 07:02:33.696481 22814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "254a16c101dd48eb8afe38e3393c3dca"
format_stamp: "Formatted at 2026-08-12 07:02:33 on dist-test-slave-tc2s"
server_key: "f649a7c099f395101f74869a0e3ca4c1"
server_key_iv: "219fcbf0df2824309ee3d075fa41b0c1"
server_key_version: "encryptionkey@0"
I20260812 07:02:33.701202 22814 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 07:02:33.704429 22837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:33.705565 22814 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 07:02:33.705703 22814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "254a16c101dd48eb8afe38e3393c3dca"
format_stamp: "Formatted at 2026-08-12 07:02:33 on dist-test-slave-tc2s"
server_key: "f649a7c099f395101f74869a0e3ca4c1"
server_key_iv: "219fcbf0df2824309ee3d075fa41b0c1"
server_key_version: "encryptionkey@0"
I20260812 07:02:33.705874 22814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:33.723129 22814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:33.726567 22814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:33.726805 22814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:33.727640 22814 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:33.728838 22814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:33.728914 22814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:33.729048 22814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:33.729102 22814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:33.759080 22814 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:39717
I20260812 07:02:33.759123 23040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:39717 every 8 connection(s)
I20260812 07:02:33.760198 22814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:02:33.760576 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 22814
I20260812 07:02:33.760769 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 07:02:33.761556 18714 external_mini_cluster.cc:1428] Setting key dc638deab3d9bf3a355eacb024168eeb
Aug 12 07:02:33 dist-test-slave-tc2s krb5kdc[22094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518153, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.131@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:02:33.780246 22542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:33.762696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:53563 (local address 127.18.70.190:43125)
0812 07:02:33.762852 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:33.762858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:33.764271 (+ 1413us) server_negotiation.cc:407] Connection header received
0812 07:02:33.766137 (+ 1866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:33.766142 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:33.766235 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:33.766321 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:33.767607 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.768325 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.770526 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.770919 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.771023 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:33.774697 (+ 3674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:33.774702 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:33.774705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:33.774737 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:33.777445 (+ 2708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:33.778140 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:33.778145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:33.778147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:33.778278 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:33.778677 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:33.778681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:33.778683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:33.778949 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:33.779082 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:33.779701 (+ 619us) server_negotiation.cc:299] Negotiation successful
0812 07:02:33.779918 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 07:02:33.781036 23043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:33.763297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43125 (local address 127.18.70.131:53563)
0812 07:02:33.764133 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:33.764179 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:33.765854 (+ 1675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:33.766500 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:33.766507 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:33.766971 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:33.767478 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:33.767495 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.768474 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.768479 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:33.770397 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:33.770413 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.771146 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.771154 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:33.771417 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:33.772070 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:02:33.772105 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:33.774504 (+ 2399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:33.777571 (+ 3067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:33.777579 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:33.777592 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:33.778023 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:33.778381 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:02:33.778386 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:02:33.778390 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:02:33.778564 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:02:33.779071 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:33.779077 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:33.779348 (+ 271us) client_negotiation.cc:769] Sending connection context
0812 07:02:33.779562 (+ 214us) client_negotiation.cc:240] Negotiation successful
0812 07:02:33.780035 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":325,"threads_started":1}
I20260812 07:02:33.782195 23041 heartbeater.cc:347] Connected to a master server at 127.18.70.190:43125
I20260812 07:02:33.782420 23041 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:33.783015 23041 heartbeater.cc:511] Master 127.18.70.190:43125 requested a full tablet report, sending...
I20260812 07:02:33.784253 22176 ts_manager.cc:194] Registered new tserver with Master: 254a16c101dd48eb8afe38e3393c3dca (127.18.70.131:39717)
I20260812 07:02:33.785012 22176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.70.131@KRBTEST.COM'} at 127.18.70.131:53563
I20260812 07:02:33.788389 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 07:02:33.799227 22540 heartbeater.cc:503] Master 127.18.70.190:43125 was elected leader, sending a full tablet report...
I20260812 07:02:33.803785 22542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:33.792273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36786 (local address 127.18.70.190:43125)
0812 07:02:33.792465 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:33.792471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:33.792906 (+ 435us) server_negotiation.cc:407] Connection header received
0812 07:02:33.793049 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:33.793052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:33.793105 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:33.793173 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:33.794541 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.795200 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.796377 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.796748 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.796845 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:33.798926 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:33.798930 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:33.798933 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:33.798961 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:33.801617 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:33.802235 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:33.802238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:33.802240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:33.802371 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:33.802660 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:33.802663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:33.802665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:33.802938 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:33.803123 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:33.803375 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 07:02:33.803518 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 07:02:33.806893 22176 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 07:02:33.813620 22176 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 07:02:33.853513 23070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:33.825276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40568 (local address 127.18.70.130:46277)
0812 07:02:33.845131 (+ 19855us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:33.845138 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:33.845163 (+ 25us) server_negotiation.cc:407] Connection header received
0812 07:02:33.845252 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:33.845258 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:33.845472 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:33.845648 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:33.846894 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.848333 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.850843 (+ 2510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.852290 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.852430 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:33.852625 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:33.853015 (+ 390us) server_negotiation.cc:299] Negotiation successful
0812 07:02:33.853183 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19699,"thread_start_us":19566,"threads_started":1}
I20260812 07:02:33.853806 23066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:33.824405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:36663 (local address 127.0.0.1:59448)
0812 07:02:33.840117 (+ 15712us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:33.840167 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:33.840346 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:33.845488 (+ 5142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:33.845496 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:33.845527 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:33.846404 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:33.846418 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.848243 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.848248 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:33.850755 (+ 2507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:33.850771 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.852511 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.852521 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:33.852727 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:33.852816 (+ 89us) client_negotiation.cc:769] Sending connection context
0812 07:02:33.852931 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 07:02:33.853185 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15469,"mutex_wait_us":260,"thread_start_us":15328,"threads_started":1}
I20260812 07:02:33.853838 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:33.824603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:46277 (local address 127.0.0.1:40568)
0812 07:02:33.842015 (+ 17412us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:33.842035 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:33.842156 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:33.845936 (+ 3780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:33.845941 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:33.845997 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:33.846710 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:33.846723 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.848457 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.848460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:33.850672 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:33.850684 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.852535 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.852541 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:33.852723 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:33.852817 (+ 94us) client_negotiation.cc:769] Sending connection context
0812 07:02:33.852931 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 07:02:33.853185 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17260,"mutex_wait_us":263,"spinlock_wait_cycles":4864,"thread_start_us":20984,"threads_started":1}
I20260812 07:02:33.854880 23069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:33.824652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59448 (local address 127.18.70.129:36663)
0812 07:02:33.844857 (+ 20205us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:33.844865 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:33.844895 (+ 30us) server_negotiation.cc:407] Connection header received
0812 07:02:33.844989 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:33.844996 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:33.845229 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:33.846402 (+ 1173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:33.846642 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.848107 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.850899 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.852290 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.852430 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:33.852654 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:33.853783 (+ 1129us) server_negotiation.cc:299] Negotiation successful
0812 07:02:33.853992 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20041,"thread_start_us":19876,"threads_started":1}
I20260812 07:02:33.855289 23068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:33.826040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:39717 (local address 127.0.0.1:40914)
0812 07:02:33.845470 (+ 19430us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:33.845487 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:33.845596 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:33.846253 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:33.846258 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:33.846285 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:33.846854 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:33.846866 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.848137 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.848142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:33.850755 (+ 2613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:33.850771 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.854525 (+ 3754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.854532 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:33.854706 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:33.854738 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 07:02:33.854824 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 07:02:33.854943 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19285,"mutex_wait_us":149,"thread_start_us":15693,"threads_started":1}
I20260812 07:02:33.855952 23072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:33.826609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40914 (local address 127.18.70.131:39717)
0812 07:02:33.844932 (+ 18323us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:33.844940 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:33.845718 (+ 778us) server_negotiation.cc:407] Connection header received
0812 07:02:33.845804 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:33.845809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:33.846038 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:33.846254 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:33.847021 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.848006 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.852729 (+ 4723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:33.854028 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:33.854150 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:33.854379 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:33.855600 (+ 1221us) server_negotiation.cc:299] Negotiation successful
0812 07:02:33.855718 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18160,"thread_start_us":18337,"threads_started":1}
I20260812 07:02:33.857664 22669 tablet_service.cc:1467] Processing CreateTablet for tablet d8c61f51c19e4878a5cac234ae1ca6ef (DEFAULT_TABLE table=test-table [id=991fb1e02b354724b361a99b23ed073f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:33.858846 22669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8c61f51c19e4878a5cac234ae1ca6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:33.858878 22917 tablet_service.cc:1467] Processing CreateTablet for tablet d8c61f51c19e4878a5cac234ae1ca6ef (DEFAULT_TABLE table=test-table [id=991fb1e02b354724b361a99b23ed073f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:33.860251 22917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8c61f51c19e4878a5cac234ae1ca6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:33.860673 22418 tablet_service.cc:1467] Processing CreateTablet for tablet d8c61f51c19e4878a5cac234ae1ca6ef (DEFAULT_TABLE table=test-table [id=991fb1e02b354724b361a99b23ed073f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:33.862015 22418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8c61f51c19e4878a5cac234ae1ca6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:33.871493 23073 tablet_bootstrap.cc:492] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: Bootstrap starting.
I20260812 07:02:33.874439 23073 tablet_bootstrap.cc:654] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:33.875644 23078 tablet_bootstrap.cc:492] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: Bootstrap starting.
I20260812 07:02:33.876130 23073 log.cc:824] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:33.877046 23077 tablet_bootstrap.cc:492] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: Bootstrap starting.
I20260812 07:02:33.879441 23078 tablet_bootstrap.cc:654] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:33.880398 23073 tablet_bootstrap.cc:492] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: No bootstrap required, opened a new log
I20260812 07:02:33.880517 23077 tablet_bootstrap.cc:654] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:33.880666 23073 ts_tablet_manager.cc:1397] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 07:02:33.880637 23078 log.cc:824] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:33.881562 23077 log.cc:824] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:33.883492 23078 tablet_bootstrap.cc:492] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: No bootstrap required, opened a new log
I20260812 07:02:33.883744 23078 ts_tablet_manager.cc:1397] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260812 07:02:33.884049 23077 tablet_bootstrap.cc:492] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: No bootstrap required, opened a new log
I20260812 07:02:33.884261 23077 ts_tablet_manager.cc:1397] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260812 07:02:33.890583 23073 raft_consensus.cc:348] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b5590c7f564107b196b1c987afce88" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 36663 } } peers { permanent_uuid: "a347d4131286491db56b43ab6d346086" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46277 } } peers { permanent_uuid: "254a16c101dd48eb8afe38e3393c3dca" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39717 } }
I20260812 07:02:33.890997 23073 raft_consensus.cc:374] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:33.891094 23073 raft_consensus.cc:729] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a347d4131286491db56b43ab6d346086, State: Initialized, Role: FOLLOWER
I20260812 07:02:33.891667 23073 consensus_queue.cc:260] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b5590c7f564107b196b1c987afce88" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 36663 } } peers { permanent_uuid: "a347d4131286491db56b43ab6d346086" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46277 } } peers { permanent_uuid: "254a16c101dd48eb8afe38e3393c3dca" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39717 } }
I20260812 07:02:33.891659 23077 raft_consensus.cc:348] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b5590c7f564107b196b1c987afce88" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 36663 } } peers { permanent_uuid: "a347d4131286491db56b43ab6d346086" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46277 } } peers { permanent_uuid: "254a16c101dd48eb8afe38e3393c3dca" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39717 } }
I20260812 07:02:33.892092 23077 raft_consensus.cc:374] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:33.892213 23077 raft_consensus.cc:729] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 254a16c101dd48eb8afe38e3393c3dca, State: Initialized, Role: FOLLOWER
I20260812 07:02:33.892730 23077 consensus_queue.cc:260] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b5590c7f564107b196b1c987afce88" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 36663 } } peers { permanent_uuid: "a347d4131286491db56b43ab6d346086" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46277 } } peers { permanent_uuid: "254a16c101dd48eb8afe38e3393c3dca" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39717 } }
I20260812 07:02:33.893884 23041 heartbeater.cc:503] Master 127.18.70.190:43125 was elected leader, sending a full tablet report...
I20260812 07:02:33.893970 23078 raft_consensus.cc:348] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b5590c7f564107b196b1c987afce88" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 36663 } } peers { permanent_uuid: "a347d4131286491db56b43ab6d346086" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46277 } } peers { permanent_uuid: "254a16c101dd48eb8afe38e3393c3dca" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39717 } }
I20260812 07:02:33.894356 23078 raft_consensus.cc:374] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:33.894433 23078 raft_consensus.cc:729] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02b5590c7f564107b196b1c987afce88, State: Initialized, Role: FOLLOWER
I20260812 07:02:33.894532 23077 ts_tablet_manager.cc:1428] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: Time spent starting tablet: real 0.010s user 0.005s sys 0.006s
I20260812 07:02:33.895056 23078 consensus_queue.cc:260] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b5590c7f564107b196b1c987afce88" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 36663 } } peers { permanent_uuid: "a347d4131286491db56b43ab6d346086" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46277 } } peers { permanent_uuid: "254a16c101dd48eb8afe38e3393c3dca" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39717 } }
I20260812 07:02:33.895473 22805 heartbeater.cc:503] Master 127.18.70.190:43125 was elected leader, sending a full tablet report...
I20260812 07:02:33.896142 23073 ts_tablet_manager.cc:1428] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: Time spent starting tablet: real 0.015s user 0.013s sys 0.003s
I20260812 07:02:33.897518 23078 ts_tablet_manager.cc:1428] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: Time spent starting tablet: real 0.014s user 0.006s sys 0.008s
W20260812 07:02:34.011881 23042 tablet.cc:2369] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:02:34.016672 22807 tablet.cc:2369] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:02:34.022107 22541 tablet.cc:2369] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:02:34.044612 23091 raft_consensus.cc:482] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:02:34.044880 23091 raft_consensus.cc:504] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b5590c7f564107b196b1c987afce88" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 36663 } } peers { permanent_uuid: "a347d4131286491db56b43ab6d346086" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46277 } } peers { permanent_uuid: "254a16c101dd48eb8afe38e3393c3dca" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39717 } }
I20260812 07:02:34.046581 23091 leader_election.cc:288] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a347d4131286491db56b43ab6d346086 (127.18.70.130:46277), 254a16c101dd48eb8afe38e3393c3dca (127.18.70.131:39717)
I20260812 07:02:34.054672 23072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:34.047044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:57065 (local address 127.18.70.131:39717)
0812 07:02:34.047488 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:34.047494 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:34.047978 (+ 484us) server_negotiation.cc:407] Connection header received
0812 07:02:34.048084 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:34.048089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:34.048163 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:34.048250 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:34.048912 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.049996 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.052388 (+ 2392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.053584 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.053741 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:34.053819 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:34.054283 (+ 464us) server_negotiation.cc:299] Negotiation successful
0812 07:02:34.054410 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308}
I20260812 07:02:34.054672 23070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:34.046980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:46787 (local address 127.18.70.130:46277)
0812 07:02:34.047307 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:34.047314 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:34.047693 (+ 379us) server_negotiation.cc:407] Connection header received
0812 07:02:34.047942 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:34.047948 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:34.048031 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:34.048127 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:34.048702 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.049769 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.052413 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.053596 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.053737 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:34.053813 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:34.054283 (+ 470us) server_negotiation.cc:299] Negotiation successful
0812 07:02:34.054427 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260812 07:02:34.054889 23094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:34.046903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:39717 (local address 127.18.70.129:57065)
0812 07:02:34.047856 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:34.047872 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:34.047971 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:34.048283 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:34.048287 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:34.048324 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:34.048769 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:34.048778 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.050122 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.050127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:34.052242 (+ 2115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:34.052258 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.053835 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.053840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:34.054087 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:34.054166 (+ 79us) client_negotiation.cc:769] Sending connection context
0812 07:02:34.054257 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 07:02:34.054423 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"mutex_wait_us":115,"thread_start_us":641,"threads_started":1}
I20260812 07:02:34.054915 23093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:34.046761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:46277 (local address 127.18.70.129:46787)
0812 07:02:34.047574 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:34.047594 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:34.047762 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:34.048153 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:34.048156 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:34.048178 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:34.048560 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:34.048573 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.049917 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.049922 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:34.052246 (+ 2324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:34.052258 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.053803 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.053810 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:34.054084 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:34.054159 (+ 75us) client_negotiation.cc:769] Sending connection context
0812 07:02:34.054257 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 07:02:34.054423 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"mutex_wait_us":135,"thread_start_us":464,"threads_started":1}
I20260812 07:02:34.055912 22955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c61f51c19e4878a5cac234ae1ca6ef" candidate_uuid: "02b5590c7f564107b196b1c987afce88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "254a16c101dd48eb8afe38e3393c3dca" is_pre_election: true
I20260812 07:02:34.055912 22704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c61f51c19e4878a5cac234ae1ca6ef" candidate_uuid: "02b5590c7f564107b196b1c987afce88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a347d4131286491db56b43ab6d346086" is_pre_election: true
I20260812 07:02:34.056483 22955 raft_consensus.cc:2454] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02b5590c7f564107b196b1c987afce88 in term 0.
I20260812 07:02:34.056471 22704 raft_consensus.cc:2454] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02b5590c7f564107b196b1c987afce88 in term 0.
I20260812 07:02:34.057119 22334 leader_election.cc:302] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02b5590c7f564107b196b1c987afce88, a347d4131286491db56b43ab6d346086; no voters:
I20260812 07:02:34.057479 23091 raft_consensus.cc:2781] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:02:34.057607 23091 raft_consensus.cc:482] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:02:34.057704 23091 raft_consensus.cc:3037] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:34.059878 23091 raft_consensus.cc:504] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b5590c7f564107b196b1c987afce88" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 36663 } } peers { permanent_uuid: "a347d4131286491db56b43ab6d346086" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46277 } } peers { permanent_uuid: "254a16c101dd48eb8afe38e3393c3dca" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39717 } }
I20260812 07:02:34.060464 23091 leader_election.cc:288] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [CANDIDATE]: Term 1 election: Requested vote from peers a347d4131286491db56b43ab6d346086 (127.18.70.130:46277), 254a16c101dd48eb8afe38e3393c3dca (127.18.70.131:39717)
I20260812 07:02:34.060829 22704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c61f51c19e4878a5cac234ae1ca6ef" candidate_uuid: "02b5590c7f564107b196b1c987afce88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a347d4131286491db56b43ab6d346086"
I20260812 07:02:34.060930 22955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c61f51c19e4878a5cac234ae1ca6ef" candidate_uuid: "02b5590c7f564107b196b1c987afce88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "254a16c101dd48eb8afe38e3393c3dca"
I20260812 07:02:34.061056 22704 raft_consensus.cc:3037] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:34.061107 22955 raft_consensus.cc:3037] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:34.064194 22955 raft_consensus.cc:2454] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02b5590c7f564107b196b1c987afce88 in term 1.
I20260812 07:02:34.064194 22704 raft_consensus.cc:2454] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02b5590c7f564107b196b1c987afce88 in term 1.
I20260812 07:02:34.064550 22333 leader_election.cc:302] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02b5590c7f564107b196b1c987afce88, 254a16c101dd48eb8afe38e3393c3dca; no voters:
I20260812 07:02:34.064827 23091 raft_consensus.cc:2781] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:34.065258 23091 raft_consensus.cc:686] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 1 LEADER]: Becoming Leader. State: Replica: 02b5590c7f564107b196b1c987afce88, State: Running, Role: LEADER
I20260812 07:02:34.065691 23091 consensus_queue.cc:237] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b5590c7f564107b196b1c987afce88" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 36663 } } peers { permanent_uuid: "a347d4131286491db56b43ab6d346086" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46277 } } peers { permanent_uuid: "254a16c101dd48eb8afe38e3393c3dca" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39717 } }
I20260812 07:02:34.070223 22174 catalog_manager.cc:5495] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02b5590c7f564107b196b1c987afce88 (127.18.70.129). New cstate: current_term: 1 leader_uuid: "02b5590c7f564107b196b1c987afce88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b5590c7f564107b196b1c987afce88" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 36663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a347d4131286491db56b43ab6d346086" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "254a16c101dd48eb8afe38e3393c3dca" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39717 } health_report { overall_health: UNKNOWN } } }
I20260812 07:02:34.137434 23069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:34.132712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59452 (local address 127.18.70.129:36663)
0812 07:02:34.132916 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:34.132927 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:34.132945 (+ 18us) server_negotiation.cc:407] Connection header received
0812 07:02:34.133068 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:34.133072 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:34.133158 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:34.133274 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:02:34.133563 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.134302 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.135584 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.135991 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.136077 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:34.136470 (+ 393us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:02:34.136964 (+ 494us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:02:34.137073 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:34.137109 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 07:02:34.137172 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 07:02:34.145432 22704 raft_consensus.cc:1261] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086 [term 1 FOLLOWER]: Refusing update from remote peer 02b5590c7f564107b196b1c987afce88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:34.145432 22955 raft_consensus.cc:1261] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca [term 1 FOLLOWER]: Refusing update from remote peer 02b5590c7f564107b196b1c987afce88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:34.146451 23096 consensus_queue.cc:1035] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "254a16c101dd48eb8afe38e3393c3dca" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 39717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:34.146816 23091 consensus_queue.cc:1035] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a347d4131286491db56b43ab6d346086" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 46277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:34.162401 23102 mvcc.cc:205] Tried to move back new op lower bound from 7317578359369043968 to 7317578359056494592. Current Snapshot: MvccSnapshot[applied={T|T < 7317578359369043968}]
I20260812 07:02:34.174428 22175 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:34.174711 22175 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:34.178279 22175 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dbd00689200345318571c5d03bdea59d: Sending DeleteTablet for 3 replicas of tablet d8c61f51c19e4878a5cac234ae1ca6ef
I20260812 07:02:34.179404 22669 tablet_service.cc:1514] Processing DeleteTablet for tablet d8c61f51c19e4878a5cac234ae1ca6ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:34 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:40568
I20260812 07:02:34.179385 22418 tablet_service.cc:1514] Processing DeleteTablet for tablet d8c61f51c19e4878a5cac234ae1ca6ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:34 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:59448
I20260812 07:02:34.179726 22917 tablet_service.cc:1514] Processing DeleteTablet for tablet d8c61f51c19e4878a5cac234ae1ca6ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:34 UTC) from {username='kudu', principal='kudu/127.18.70.190@KRBTEST.COM'} at 127.0.0.1:40914
I20260812 07:02:34.181578 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 22301
I20260812 07:02:34.190786 23118 tablet_replica.cc:330] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: stopping tablet replica
I20260812 07:02:34.191409 23118 raft_consensus.cc:2229] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:02:34.192044 23118 raft_consensus.cc:2258] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:34.194326 23118 ts_tablet_manager.cc:1905] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:34.199116 23115 tablet_replica.cc:330] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: stopping tablet replica
I20260812 07:02:34.199934 23119 tablet_replica.cc:330] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: stopping tablet replica
I20260812 07:02:34.200351 23119 raft_consensus.cc:2229] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:02:34.200848 23119 raft_consensus.cc:2258] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:34.201476 23115 raft_consensus.cc:2229] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 1 LEADER]: Raft consensus shutting down.
I20260812 07:02:34.202271 23115 raft_consensus.cc:2258] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:34.203487 23119 ts_tablet_manager.cc:1905] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:34.204250 23115 ts_tablet_manager.cc:1905] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:34.206233 23118 ts_tablet_manager.cc:1918] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:34.206444 23118 log.cc:1196] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/d8c61f51c19e4878a5cac234ae1ca6ef
I20260812 07:02:34.207075 23118 ts_tablet_manager.cc:1939] T d8c61f51c19e4878a5cac234ae1ca6ef P a347d4131286491db56b43ab6d346086: Deleting consensus metadata
I20260812 07:02:34.210328 23119 ts_tablet_manager.cc:1918] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 12 07:02:34 dist-test-slave-tc2s krb5kdc[22094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.129@KRBTEST.COM
I20260812 07:02:34.210579 23119 log.cc:1196] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/d8c61f51c19e4878a5cac234ae1ca6ef
I20260812 07:02:34.211172 23119 ts_tablet_manager.cc:1939] T d8c61f51c19e4878a5cac234ae1ca6ef P 254a16c101dd48eb8afe38e3393c3dca: Deleting consensus metadata
I20260812 07:02:34.211350 23115 ts_tablet_manager.cc:1918] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:34.211562 23115 log.cc:1196] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786517832212618-18714-0/minicluster-data/ts-0/wal/wals/d8c61f51c19e4878a5cac234ae1ca6ef
I20260812 07:02:34.212249 23115 ts_tablet_manager.cc:1939] T d8c61f51c19e4878a5cac234ae1ca6ef P 02b5590c7f564107b196b1c987afce88: Deleting consensus metadata
I20260812 07:02:34.212404 22156 catalog_manager.cc:4841] TS a347d4131286491db56b43ab6d346086 (127.18.70.130:46277): tablet d8c61f51c19e4878a5cac234ae1ca6ef (table test-table [id=991fb1e02b354724b361a99b23ed073f]) successfully deleted
I20260812 07:02:34.212971 22154 catalog_manager.cc:4841] TS 254a16c101dd48eb8afe38e3393c3dca (127.18.70.131:39717): tablet d8c61f51c19e4878a5cac234ae1ca6ef (table test-table [id=991fb1e02b354724b361a99b23ed073f]) successfully deleted
I20260812 07:02:34.213963 22148 catalog_manager.cc:4841] TS 02b5590c7f564107b196b1c987afce88 (127.18.70.129:36663): tablet d8c61f51c19e4878a5cac234ae1ca6ef (table test-table [id=991fb1e02b354724b361a99b23ed073f]) successfully deleted
I20260812 07:02:34.220216 23069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:34.184432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59466 (local address 127.18.70.129:36663)
0812 07:02:34.184624 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:34.184632 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:34.199246 (+ 14614us) server_negotiation.cc:407] Connection header received
0812 07:02:34.199427 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:34.199433 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:34.199523 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:34.199642 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:34.201588 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.202852 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.205155 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.205848 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.206012 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:34.213961 (+ 7949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:34.213975 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:34.213997 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:34.214048 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:34.217023 (+ 2975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:34.217843 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:34.217853 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:34.217856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:34.218051 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:34.218456 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:34.218459 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:34.218461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:34.218884 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:34.219163 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:34.219641 (+ 478us) server_negotiation.cc:299] Negotiation successful
0812 07:02:34.219882 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 07:02:34.220801 22531 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:34.331498 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 22301
I20260812 07:02:34.356246 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 22550
Aug 12 07:02:34 dist-test-slave-tc2s krb5kdc[22094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.130@KRBTEST.COM
I20260812 07:02:34.370847 23070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:34.356957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40576 (local address 127.18.70.130:46277)
0812 07:02:34.357135 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:34.357141 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:34.357161 (+ 20us) server_negotiation.cc:407] Connection header received
0812 07:02:34.357309 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:34.357313 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:34.357388 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:34.357470 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:34.358784 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.359533 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.360800 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.361203 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.361312 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:34.365543 (+ 4231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:34.365555 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:34.365569 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:34.365602 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:34.368252 (+ 2650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:34.368875 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:34.368882 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:34.368884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:34.369008 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:34.369341 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:34.369344 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:34.369346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:34.369715 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:34.370044 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:34.370315 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 07:02:34.370525 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 07:02:34.371480 22797 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:34.458386 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 22550
I20260812 07:02:34.485462 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 22814
Aug 12 07:02:34 dist-test-slave-tc2s krb5kdc[22094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.131@KRBTEST.COM
I20260812 07:02:34.499605 23072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:34.486199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40924 (local address 127.18.70.131:39717)
0812 07:02:34.486397 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:34.486402 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:34.486420 (+ 18us) server_negotiation.cc:407] Connection header received
0812 07:02:34.486517 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:34.486521 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:34.486595 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:34.486675 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:34.487939 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.488654 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.489851 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:34.490288 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:34.490400 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:34.494586 (+ 4186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:34.494602 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:34.494620 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:34.494657 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:34.497233 (+ 2576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:34.497800 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:34.497806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:34.497809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:34.497986 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:34.498270 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:34.498272 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:34.498274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:34.498623 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:34.498833 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:34.499117 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 07:02:34.499275 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 07:02:34.500274 23031 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:34.586512 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 22814
I20260812 07:02:34.604545 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 22121
I20260812 07:02:34.605579 22235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:34.713613 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 22121
2026-08-12T07:02:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4484 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T07:02:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:34Z Disabled control of system clock
I20260812 07:02:34.801054 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:35347
--webserver_interface=127.18.70.190
--webserver_port=0
--builtin_ntp_servers=127.18.70.148:46873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:35347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 07:02:35.125814 23136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:35.126106 23136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:35.126184 23136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:35.133169 23136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:35.133261 23136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:35.133303 23136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:35.133358 23136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:35.133409 23136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:35.142244 23136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:35347
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:35347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:35.143366 23136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:35.145416 23136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:35.156968 23144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:35.157032 23146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:35.157003 23149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:35.158057 23136 server_base.cc:1034] running on GCE node
I20260812 07:02:35.158752 23136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:35.160049 23136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:35.161248 23136 hybrid_clock.cc:648] HybridClock initialized: now 1786518155161205 us; error 29 us; skew 500 ppm
I20260812 07:02:35.161600 23136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:35.163826 23136 webserver.cc:460] Webserver started at http://127.18.70.190:40503/ using document root <none> and password file <none>
I20260812 07:02:35.164471 23136 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:35.164563 23136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:35.164868 23136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:35.167891 23136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "05502e7bd618455fb2185e9ce6f05200"
format_stamp: "Formatted at 2026-08-12 07:02:35 on dist-test-slave-tc2s"
server_key: "e91f158b9f250e11b854cf1093f0134e"
server_key_iv: "29a68c88e4137ef8a6cc612b8e89308d"
server_key_version: "encryptionkey@0"
I20260812 07:02:35.168898 23136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "05502e7bd618455fb2185e9ce6f05200"
format_stamp: "Formatted at 2026-08-12 07:02:35 on dist-test-slave-tc2s"
server_key: "e91f158b9f250e11b854cf1093f0134e"
server_key_iv: "29a68c88e4137ef8a6cc612b8e89308d"
server_key_version: "encryptionkey@0"
I20260812 07:02:35.173673 23136 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260812 07:02:35.176893 23164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:35.178110 23136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:02:35.178273 23136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "05502e7bd618455fb2185e9ce6f05200"
format_stamp: "Formatted at 2026-08-12 07:02:35 on dist-test-slave-tc2s"
server_key: "e91f158b9f250e11b854cf1093f0134e"
server_key_iv: "29a68c88e4137ef8a6cc612b8e89308d"
server_key_version: "encryptionkey@0"
I20260812 07:02:35.178475 23136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:35.189667 23136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:35.190426 23136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:35.190676 23136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:35.207676 23136 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:35347
I20260812 07:02:35.207749 23254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:35347 every 8 connection(s)
I20260812 07:02:35.209303 23136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:35.211750 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 23136
I20260812 07:02:35.211915 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:35.212343 18714 external_mini_cluster.cc:1428] Setting key c3353fa1b50f243b927ee53ab9da3964
I20260812 07:02:35.213177 23257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:35.225196 23261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:35.214026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56358 (local address 127.18.70.190:35347)
0812 07:02:35.214968 (+ 942us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:35.214978 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:35.215018 (+ 40us) server_negotiation.cc:407] Connection header received
0812 07:02:35.216560 (+ 1542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:35.216581 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:35.217006 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:35.217314 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:35.217887 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:35.219245 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:35.221099 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:35.221721 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:35.221855 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:35.223068 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:35.223079 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:35.223091 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:35.223617 (+ 526us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:35.223702 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:35.223722 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:35.223815 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:35.224036 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 07:02:35.224322 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":361,"threads_started":1}
I20260812 07:02:35.226389 23257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200: Bootstrap starting.
I20260812 07:02:35.229488 23257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:35.230424 23257 log.cc:824] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:35.232941 23257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200: No bootstrap required, opened a new log
I20260812 07:02:35.240114 23257 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05502e7bd618455fb2185e9ce6f05200" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35347 } }
I20260812 07:02:35.240455 23257 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:35.240545 23257 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05502e7bd618455fb2185e9ce6f05200, State: Initialized, Role: FOLLOWER
I20260812 07:02:35.241034 23257 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05502e7bd618455fb2185e9ce6f05200" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35347 } }
I20260812 07:02:35.241250 23257 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:35.241375 23257 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:35.241537 23257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:35.243584 23257 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05502e7bd618455fb2185e9ce6f05200" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35347 } }
I20260812 07:02:35.244102 23257 leader_election.cc:302] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05502e7bd618455fb2185e9ce6f05200; no voters:
I20260812 07:02:35.244618 23257 leader_election.cc:288] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:35.244735 23264 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:35.245440 23264 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [term 1 LEADER]: Becoming Leader. State: Replica: 05502e7bd618455fb2185e9ce6f05200, State: Running, Role: LEADER
I20260812 07:02:35.245965 23264 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05502e7bd618455fb2185e9ce6f05200" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35347 } }
I20260812 07:02:35.246471 23257 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:35.248673 23265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05502e7bd618455fb2185e9ce6f05200" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05502e7bd618455fb2185e9ce6f05200" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35347 } } }
I20260812 07:02:35.249212 23265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:35.248703 23268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05502e7bd618455fb2185e9ce6f05200. Latest consensus state: current_term: 1 leader_uuid: "05502e7bd618455fb2185e9ce6f05200" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05502e7bd618455fb2185e9ce6f05200" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 35347 } } }
I20260812 07:02:35.249621 23268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200 [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:35.253499 23273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:35.258944 23273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:35.267652 23273 catalog_manager.cc:1347] Generated new cluster ID: 4d7f245a4ac14f7b8632fbee34821e7f
I20260812 07:02:35.267750 23273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:35.279055 23273 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:35.280707 23273 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:35.288908 23273 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200: Generated new TSK 0
I20260812 07:02:35.289772 23273 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:35.295459 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.129:0
--local_ip_for_outbound_sockets=127.18.70.129
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35347
--builtin_ntp_servers=127.18.70.148:46873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 07:02:35.629215 23295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:35.629478 23295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:35.629611 23295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:35.636518 23295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:35.636610 23295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:35.636751 23295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.129
I20260812 07:02:35.645740 23295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.70.129
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.129
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:35.646981 23295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:35.648794 23295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:35.661397 23302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:35.661429 23313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:35.661401 23306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:35.662127 23295 server_base.cc:1034] running on GCE node
I20260812 07:02:35.662690 23295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:35.663549 23295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:35.664749 23295 hybrid_clock.cc:648] HybridClock initialized: now 1786518155664690 us; error 47 us; skew 500 ppm
I20260812 07:02:35.665043 23295 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:35.667222 23295 webserver.cc:460] Webserver started at http://127.18.70.129:43461/ using document root <none> and password file <none>
I20260812 07:02:35.667830 23295 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:35.667934 23295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:35.668226 23295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:35.670946 23295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/data/instance:
uuid: "31e4178270274579b4f0d449d7ca8ebb"
format_stamp: "Formatted at 2026-08-12 07:02:35 on dist-test-slave-tc2s"
server_key: "a19f41ab68fd4b68dd736650a3372799"
server_key_iv: "c61cff52c7383eacce2f0757bf2bcd7e"
server_key_version: "encryptionkey@0"
I20260812 07:02:35.671681 23295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance:
uuid: "31e4178270274579b4f0d449d7ca8ebb"
format_stamp: "Formatted at 2026-08-12 07:02:35 on dist-test-slave-tc2s"
server_key: "a19f41ab68fd4b68dd736650a3372799"
server_key_iv: "c61cff52c7383eacce2f0757bf2bcd7e"
server_key_version: "encryptionkey@0"
I20260812 07:02:35.676510 23295 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260812 07:02:35.679792 23324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:35.680979 23295 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 07:02:35.681124 23295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/wal
uuid: "31e4178270274579b4f0d449d7ca8ebb"
format_stamp: "Formatted at 2026-08-12 07:02:35 on dist-test-slave-tc2s"
server_key: "a19f41ab68fd4b68dd736650a3372799"
server_key_iv: "c61cff52c7383eacce2f0757bf2bcd7e"
server_key_version: "encryptionkey@0"
I20260812 07:02:35.681358 23295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:35.696564 23295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:35.697252 23295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:35.697522 23295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:35.698423 23295 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:35.699769 23295 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:35.699877 23295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:35.699976 23295 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:35.700047 23295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:35.728807 23295 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.129:34563
I20260812 07:02:35.728865 23532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.129:34563 every 8 connection(s)
I20260812 07:02:35.730048 23295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/data/info.pb
I20260812 07:02:35.735602 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 23295
I20260812 07:02:35.735785 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-0/wal/instance
I20260812 07:02:35.736354 18714 external_mini_cluster.cc:1428] Setting key 8bb56b8142d76142f7594c7a891d0db3
I20260812 07:02:35.739104 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.130:0
--local_ip_for_outbound_sockets=127.18.70.130
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35347
--builtin_ntp_servers=127.18.70.148:46873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 07:02:35.742585 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:35.732420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.129:57015 (local address 127.18.70.190:35347)
0812 07:02:35.732847 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:35.732852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:35.733991 (+ 1139us) server_negotiation.cc:407] Connection header received
0812 07:02:35.735875 (+ 1884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:35.735882 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:35.735959 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:35.736055 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:35.737286 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:35.738327 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:35.739928 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:35.740538 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:35.740665 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:35.741794 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:35.741800 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:35.741805 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:35.741826 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:35.741882 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:35.741919 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:35.742011 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:35.742178 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 07:02:35.742271 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":211,"threads_started":1}
I20260812 07:02:35.743361 23538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:35.732953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:35347 (local address 127.18.70.129:57015)
0812 07:02:35.733806 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:35.733847 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:35.735537 (+ 1690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:35.736310 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:35.736319 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:35.736425 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:35.737115 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:35.737136 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:35.738488 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:35.738492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:35.739782 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:35.739795 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:35.740715 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:35.740720 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:35.740907 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:35.741501 (+ 594us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 07:02:35.741504 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:35.741538 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 07:02:35.741610 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:35.742008 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:35.742015 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:35.742020 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 07:02:35.742150 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 07:02:35.742413 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":286,"threads_started":1}
I20260812 07:02:35.744694 23535 heartbeater.cc:347] Connected to a master server at 127.18.70.190:35347
I20260812 07:02:35.744958 23535 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:35.745594 23535 heartbeater.cc:511] Master 127.18.70.190:35347 requested a full tablet report, sending...
I20260812 07:02:35.747659 23189 ts_manager.cc:194] Registered new tserver with Master: 31e4178270274579b4f0d449d7ca8ebb (127.18.70.129:34563)
I20260812 07:02:35.749521 23189 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.129:57015
W20260812 07:02:36.065980 23539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:36.066231 23539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:36.066366 23539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:36.073222 23539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:36.073318 23539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:36.073474 23539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.130
I20260812 07:02:36.082033 23539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.70.130
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.130
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:36.083149 23539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:36.084830 23539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:36.096992 23554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:36.097033 23549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:36.097030 23557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:36.098115 23539 server_base.cc:1034] running on GCE node
I20260812 07:02:36.098690 23539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:36.099530 23539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:36.100715 23539 hybrid_clock.cc:648] HybridClock initialized: now 1786518156100677 us; error 29 us; skew 500 ppm
I20260812 07:02:36.101011 23539 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:36.103124 23539 webserver.cc:460] Webserver started at http://127.18.70.130:38907/ using document root <none> and password file <none>
I20260812 07:02:36.103719 23539 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:36.103807 23539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:36.104103 23539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:36.106769 23539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/data/instance:
uuid: "964fe703882244e091b6ed9de25e0caf"
format_stamp: "Formatted at 2026-08-12 07:02:36 on dist-test-slave-tc2s"
server_key: "475d7d632838c3b88f75eae47e599c57"
server_key_iv: "207497e395a519f5c75a74217b3ec368"
server_key_version: "encryptionkey@0"
I20260812 07:02:36.107497 23539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance:
uuid: "964fe703882244e091b6ed9de25e0caf"
format_stamp: "Formatted at 2026-08-12 07:02:36 on dist-test-slave-tc2s"
server_key: "475d7d632838c3b88f75eae47e599c57"
server_key_iv: "207497e395a519f5c75a74217b3ec368"
server_key_version: "encryptionkey@0"
I20260812 07:02:36.112120 23539 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 07:02:36.115471 23566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:36.116611 23539 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 07:02:36.116756 23539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/wal
uuid: "964fe703882244e091b6ed9de25e0caf"
format_stamp: "Formatted at 2026-08-12 07:02:36 on dist-test-slave-tc2s"
server_key: "475d7d632838c3b88f75eae47e599c57"
server_key_iv: "207497e395a519f5c75a74217b3ec368"
server_key_version: "encryptionkey@0"
I20260812 07:02:36.116958 23539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:36.129770 23539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:36.130501 23539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:36.130761 23539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:36.131676 23539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:36.133024 23539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:36.133112 23539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:36.133214 23539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:36.133280 23539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:36.163877 23539 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.130:34403
I20260812 07:02:36.163938 23788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.130:34403 every 8 connection(s)
I20260812 07:02:36.165093 23539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/data/info.pb
I20260812 07:02:36.167923 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 23539
I20260812 07:02:36.168090 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/wal/instance
I20260812 07:02:36.168501 18714 external_mini_cluster.cc:1428] Setting key 6d7757490212e992a55fc0ce5473b67d
I20260812 07:02:36.171245 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.70.131:0
--local_ip_for_outbound_sockets=127.18.70.131
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35347
--builtin_ntp_servers=127.18.70.148:46873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 07:02:36.177718 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.167538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:40355 (local address 127.18.70.190:35347)
0812 07:02:36.167768 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:36.167774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:36.169204 (+ 1430us) server_negotiation.cc:407] Connection header received
0812 07:02:36.171143 (+ 1939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:36.171148 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:36.171233 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:36.171344 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:36.172455 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.173423 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.175009 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.175556 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.175676 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.176883 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:36.176889 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:36.176893 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:36.176913 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:36.176951 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:36.176966 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:36.177050 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:36.177334 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 07:02:36.177440 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 07:02:36.178617 23799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.168023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:35347 (local address 127.18.70.130:40355)
0812 07:02:36.169041 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:36.169093 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:36.170890 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:36.171638 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:36.171646 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:36.171731 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:36.172266 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.172285 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.173583 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.173587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.174867 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.174882 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.175742 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.175746 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.175940 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.176588 (+ 648us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 07:02:36.176590 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:36.176628 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 07:02:36.176701 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:36.177138 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:36.177147 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:36.177154 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 07:02:36.177304 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 07:02:36.177595 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":314,"threads_started":1}
I20260812 07:02:36.179914 23790 heartbeater.cc:347] Connected to a master server at 127.18.70.190:35347
I20260812 07:02:36.180207 23790 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:36.181066 23790 heartbeater.cc:511] Master 127.18.70.190:35347 requested a full tablet report, sending...
I20260812 07:02:36.182552 23189 ts_manager.cc:194] Registered new tserver with Master: 964fe703882244e091b6ed9de25e0caf (127.18.70.130:34403)
I20260812 07:02:36.183429 23189 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.130:40355
W20260812 07:02:36.505816 23800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:36.506107 23800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:36.506201 23800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:36.513171 23800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:36.513273 23800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:36.513391 23800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.70.131
I20260812 07:02:36.522303 23800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.70.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.70.131
--webserver_port=0
--tserver_master_addrs=127.18.70.190:35347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.70.131
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:36.523519 23800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:36.525241 23800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:36.537995 23812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:36.538067 23813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:36.538043 23816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:36.538830 23800 server_base.cc:1034] running on GCE node
I20260812 07:02:36.539443 23800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:36.540346 23800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:36.541549 23800 hybrid_clock.cc:648] HybridClock initialized: now 1786518156541492 us; error 47 us; skew 500 ppm
I20260812 07:02:36.541846 23800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 07:02:36.544026 23800 webserver.cc:460] Webserver started at http://127.18.70.131:41183/ using document root <none> and password file <none>
I20260812 07:02:36.544667 23800 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:36.544771 23800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:36.545059 23800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:36.547811 23800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/data/instance:
uuid: "e74066baf68440dabe00e80ca3b6c148"
format_stamp: "Formatted at 2026-08-12 07:02:36 on dist-test-slave-tc2s"
server_key: "ea4f20c4ad82c092281f0e6d9f4311d1"
server_key_iv: "3d0c69d7ad844a4952949183b72ae948"
server_key_version: "encryptionkey@0"
I20260812 07:02:36.548568 23800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance:
uuid: "e74066baf68440dabe00e80ca3b6c148"
format_stamp: "Formatted at 2026-08-12 07:02:36 on dist-test-slave-tc2s"
server_key: "ea4f20c4ad82c092281f0e6d9f4311d1"
server_key_iv: "3d0c69d7ad844a4952949183b72ae948"
server_key_version: "encryptionkey@0"
I20260812 07:02:36.553411 23800 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 07:02:36.556834 23826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:36.558099 23800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 07:02:36.558246 23800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/wal
uuid: "e74066baf68440dabe00e80ca3b6c148"
format_stamp: "Formatted at 2026-08-12 07:02:36 on dist-test-slave-tc2s"
server_key: "ea4f20c4ad82c092281f0e6d9f4311d1"
server_key_iv: "3d0c69d7ad844a4952949183b72ae948"
server_key_version: "encryptionkey@0"
I20260812 07:02:36.558455 23800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:36.594445 23800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:36.595201 23800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:36.595487 23800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:36.596401 23800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 07:02:36.597762 23800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 07:02:36.597858 23800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:36.597983 23800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 07:02:36.598055 23800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:36.628214 23800 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.131:41575
I20260812 07:02:36.628271 24070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.131:41575 every 8 connection(s)
I20260812 07:02:36.629441 23800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/data/info.pb
I20260812 07:02:36.633677 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 23800
I20260812 07:02:36.633870 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/wal/instance
I20260812 07:02:36.634445 18714 external_mini_cluster.cc:1428] Setting key c0650aee87a8eab802352447b5693bfb
I20260812 07:02:36.641527 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.631744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.131:52853 (local address 127.18.70.190:35347)
0812 07:02:36.631912 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:36.631917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:36.633169 (+ 1252us) server_negotiation.cc:407] Connection header received
0812 07:02:36.635414 (+ 2245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:36.635418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:36.635491 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:36.635577 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:36.636815 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.637622 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.639195 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.639624 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.639714 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.640894 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:36.640899 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:36.640902 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:36.640919 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:36.640952 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:36.640964 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:36.641030 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:36.641184 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 07:02:36.641263 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 07:02:36.642412 24076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.632186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:35347 (local address 127.18.70.131:52853)
0812 07:02:36.633015 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:36.633049 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:36.635172 (+ 2123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:36.635818 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:36.635825 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:36.635908 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:02:36.636615 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.636643 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.637777 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.637781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.639059 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.639072 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.639812 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.639816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.640039 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.640615 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 07:02:36.640617 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:02:36.640653 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 07:02:36.640727 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:02:36.641036 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:02:36.641042 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:02:36.641047 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 07:02:36.641169 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 07:02:36.641431 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":255,"threads_started":1}
I20260812 07:02:36.643703 24072 heartbeater.cc:347] Connected to a master server at 127.18.70.190:35347
I20260812 07:02:36.643953 24072 heartbeater.cc:464] Registering TS with master...
I20260812 07:02:36.644608 24072 heartbeater.cc:511] Master 127.18.70.190:35347 requested a full tablet report, sending...
I20260812 07:02:36.645948 23189 ts_manager.cc:194] Registered new tserver with Master: e74066baf68440dabe00e80ca3b6c148 (127.18.70.131:41575)
I20260812 07:02:36.646731 23189 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.70.131:52853
I20260812 07:02:36.649304 18714 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 07:02:36.658574 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.653328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56364 (local address 127.18.70.190:35347)
0812 07:02:36.653494 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:36.653498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:36.653935 (+ 437us) server_negotiation.cc:407] Connection header received
0812 07:02:36.654092 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:36.654095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:36.654170 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:36.654244 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:36.654652 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.655348 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.656595 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.656982 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.657086 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.658078 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:36.658083 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:36.658086 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:36.658101 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:36.658128 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:36.658138 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:36.658202 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:36.658283 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 07:02:36.658348 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 07:02:36.661862 23189 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56364:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 07:02:36.668684 23189 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 07:02:36.689424 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.680959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:41575 (local address 127.0.0.1:39994)
0812 07:02:36.681474 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:36.681496 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:36.681618 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:36.682617 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:36.682621 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:36.682646 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:36.683037 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.683050 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.684765 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.684771 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.686819 (+ 2048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.686832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.688520 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.688527 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.688718 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.688768 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 07:02:36.688898 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 07:02:36.689064 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":44,"thread_start_us":226,"threads_started":1}
I20260812 07:02:36.689483 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.681286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39994 (local address 127.18.70.131:41575)
0812 07:02:36.682171 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:36.682176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:36.682202 (+ 26us) server_negotiation.cc:407] Connection header received
0812 07:02:36.682287 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:36.682294 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:36.682462 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:36.682609 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:36.683291 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.684630 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.687051 (+ 2421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.688334 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.688484 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.688750 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:36.688954 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 07:02:36.689116 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":718,"thread_start_us":549,"threads_started":1}
I20260812 07:02:36.690155 24097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.679849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.130:34403 (local address 127.0.0.1:39166)
0812 07:02:36.680571 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:36.680627 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:36.680793 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:36.681725 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:36.681731 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:36.681776 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:36.682107 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.682120 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.685031 (+ 2911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.685036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.687355 (+ 2319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.687369 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.689369 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.689375 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.689542 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.689572 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 07:02:36.689654 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 07:02:36.689772 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"mutex_wait_us":42,"thread_start_us":323,"threads_started":1}
I20260812 07:02:36.690824 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.681498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:34563 (local address 127.0.0.1:51234)
0812 07:02:36.683602 (+ 2104us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:36.683623 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:36.683737 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:36.684309 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:36.684314 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:36.684348 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:36.684690 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.684702 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.686530 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.686536 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.688189 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.688201 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.690157 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.690163 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.690333 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.690365 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 07:02:36.690441 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 07:02:36.690536 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1998,"thread_start_us":1851,"threads_started":1}
I20260812 07:02:36.691079 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.679939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39166 (local address 127.18.70.130:34403)
0812 07:02:36.680579 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:36.680589 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:36.680789 (+ 200us) server_negotiation.cc:407] Connection header received
0812 07:02:36.681034 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:36.681043 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:36.681345 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:36.681547 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:36.682491 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.684897 (+ 2406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.687544 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.688901 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.689026 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.689226 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:36.690573 (+ 1347us) server_negotiation.cc:299] Negotiation successful
0812 07:02:36.690735 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":660,"threads_started":1}
I20260812 07:02:36.692158 24107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.681988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51234 (local address 127.18.70.129:34563)
0812 07:02:36.683197 (+ 1209us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:36.683204 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:36.683788 (+ 584us) server_negotiation.cc:407] Connection header received
0812 07:02:36.683900 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:36.683907 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:36.684091 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:36.684274 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:36.684854 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.686364 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.688363 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.689699 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.689824 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.690045 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:36.691013 (+ 968us) server_negotiation.cc:299] Negotiation successful
0812 07:02:36.691172 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1058,"thread_start_us":959,"threads_started":1}
I20260812 07:02:36.693322 23922 tablet_service.cc:1467] Processing CreateTablet for tablet b00b68968e754e4fb5155824029db736 (DEFAULT_TABLE table=test-table [id=d6d3f64d76d84212b55b80b2c718c31b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:36.694113 23652 tablet_service.cc:1467] Processing CreateTablet for tablet b00b68968e754e4fb5155824029db736 (DEFAULT_TABLE table=test-table [id=d6d3f64d76d84212b55b80b2c718c31b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:36.694608 23922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b00b68968e754e4fb5155824029db736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:36.695437 23652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b00b68968e754e4fb5155824029db736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:36.695588 23413 tablet_service.cc:1467] Processing CreateTablet for tablet b00b68968e754e4fb5155824029db736 (DEFAULT_TABLE table=test-table [id=d6d3f64d76d84212b55b80b2c718c31b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 07:02:36.696851 23413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b00b68968e754e4fb5155824029db736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:36.705478 24110 tablet_bootstrap.cc:492] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148: Bootstrap starting.
I20260812 07:02:36.708455 24110 tablet_bootstrap.cc:654] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:36.709790 24110 log.cc:824] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:36.709913 24111 tablet_bootstrap.cc:492] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf: Bootstrap starting.
I20260812 07:02:36.713482 24111 tablet_bootstrap.cc:654] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:36.714306 24112 tablet_bootstrap.cc:492] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb: Bootstrap starting.
I20260812 07:02:36.714730 24111 log.cc:824] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:36.717159 24112 tablet_bootstrap.cc:654] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:36.718467 24111 tablet_bootstrap.cc:492] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf: No bootstrap required, opened a new log
I20260812 07:02:36.718735 24111 ts_tablet_manager.cc:1397] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260812 07:02:36.718918 24112 log.cc:824] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:36.719307 24110 tablet_bootstrap.cc:492] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148: No bootstrap required, opened a new log
I20260812 07:02:36.719529 24110 ts_tablet_manager.cc:1397] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20260812 07:02:36.724014 24112 tablet_bootstrap.cc:492] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb: No bootstrap required, opened a new log
I20260812 07:02:36.724258 24112 ts_tablet_manager.cc:1397] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260812 07:02:36.726404 24110 raft_consensus.cc:348] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "964fe703882244e091b6ed9de25e0caf" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34403 } } peers { permanent_uuid: "e74066baf68440dabe00e80ca3b6c148" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 41575 } } peers { permanent_uuid: "31e4178270274579b4f0d449d7ca8ebb" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 34563 } }
I20260812 07:02:36.726722 24110 raft_consensus.cc:374] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:36.726823 24110 raft_consensus.cc:729] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e74066baf68440dabe00e80ca3b6c148, State: Initialized, Role: FOLLOWER
I20260812 07:02:36.727428 24110 consensus_queue.cc:260] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "964fe703882244e091b6ed9de25e0caf" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34403 } } peers { permanent_uuid: "e74066baf68440dabe00e80ca3b6c148" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 41575 } } peers { permanent_uuid: "31e4178270274579b4f0d449d7ca8ebb" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 34563 } }
I20260812 07:02:36.728662 24111 raft_consensus.cc:348] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "964fe703882244e091b6ed9de25e0caf" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34403 } } peers { permanent_uuid: "e74066baf68440dabe00e80ca3b6c148" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 41575 } } peers { permanent_uuid: "31e4178270274579b4f0d449d7ca8ebb" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 34563 } }
I20260812 07:02:36.729128 24111 raft_consensus.cc:374] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:36.729262 24111 raft_consensus.cc:729] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 964fe703882244e091b6ed9de25e0caf, State: Initialized, Role: FOLLOWER
I20260812 07:02:36.729969 24111 consensus_queue.cc:260] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "964fe703882244e091b6ed9de25e0caf" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34403 } } peers { permanent_uuid: "e74066baf68440dabe00e80ca3b6c148" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 41575 } } peers { permanent_uuid: "31e4178270274579b4f0d449d7ca8ebb" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 34563 } }
I20260812 07:02:36.731101 24072 heartbeater.cc:503] Master 127.18.70.190:35347 was elected leader, sending a full tablet report...
I20260812 07:02:36.731508 24110 ts_tablet_manager.cc:1428] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148: Time spent starting tablet: real 0.012s user 0.005s sys 0.007s
I20260812 07:02:36.734558 23790 heartbeater.cc:503] Master 127.18.70.190:35347 was elected leader, sending a full tablet report...
I20260812 07:02:36.736266 24111 ts_tablet_manager.cc:1428] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf: Time spent starting tablet: real 0.017s user 0.012s sys 0.004s
I20260812 07:02:36.736012 24112 raft_consensus.cc:348] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "964fe703882244e091b6ed9de25e0caf" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34403 } } peers { permanent_uuid: "e74066baf68440dabe00e80ca3b6c148" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 41575 } } peers { permanent_uuid: "31e4178270274579b4f0d449d7ca8ebb" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 34563 } }
I20260812 07:02:36.736500 24112 raft_consensus.cc:374] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:36.736608 24112 raft_consensus.cc:729] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e4178270274579b4f0d449d7ca8ebb, State: Initialized, Role: FOLLOWER
I20260812 07:02:36.737179 24112 consensus_queue.cc:260] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "964fe703882244e091b6ed9de25e0caf" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34403 } } peers { permanent_uuid: "e74066baf68440dabe00e80ca3b6c148" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 41575 } } peers { permanent_uuid: "31e4178270274579b4f0d449d7ca8ebb" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 34563 } }
I20260812 07:02:36.738245 23535 heartbeater.cc:503] Master 127.18.70.190:35347 was elected leader, sending a full tablet report...
I20260812 07:02:36.738888 24112 ts_tablet_manager.cc:1428] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260812 07:02:36.758008 24118 raft_consensus.cc:482] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 07:02:36.758214 24118 raft_consensus.cc:504] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "964fe703882244e091b6ed9de25e0caf" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34403 } } peers { permanent_uuid: "e74066baf68440dabe00e80ca3b6c148" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 41575 } } peers { permanent_uuid: "31e4178270274579b4f0d449d7ca8ebb" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 34563 } }
I20260812 07:02:36.759579 24118 leader_election.cc:288] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e74066baf68440dabe00e80ca3b6c148 (127.18.70.131:41575), 31e4178270274579b4f0d449d7ca8ebb (127.18.70.129:34563)
I20260812 07:02:36.765878 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.759829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:58113 (local address 127.18.70.131:41575)
0812 07:02:36.759983 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:36.759988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:36.760545 (+ 557us) server_negotiation.cc:407] Connection header received
0812 07:02:36.760836 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:36.760842 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:36.760913 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:36.760973 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:36.761598 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.762441 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.764252 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.765018 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.765156 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.765225 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:36.765538 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 07:02:36.765654 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 07:02:36.765995 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.759834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.131:41575 (local address 127.18.70.130:58113)
0812 07:02:36.760451 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:36.760470 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:36.760658 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:36.761120 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:36.761123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:36.761142 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:36.761463 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.761475 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.762558 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.762564 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.764066 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.764079 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.765190 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.765196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.765364 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.765415 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 07:02:36.765498 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 07:02:36.765617 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"mutex_wait_us":55,"thread_start_us":259,"threads_started":1}
I20260812 07:02:36.766029 24107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.760698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.70.130:46575 (local address 127.18.70.129:34563)
0812 07:02:36.760869 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:36.760874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:36.761135 (+ 261us) server_negotiation.cc:407] Connection header received
0812 07:02:36.761289 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:36.761294 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:36.761359 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:36.761462 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 07:02:36.761956 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.762707 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.764455 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.765179 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.765316 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.765393 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:36.765672 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 07:02:36.765787 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 07:02:36.766109 24125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.760519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:34563 (local address 127.18.70.130:46575)
0812 07:02:36.761046 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:36.761059 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 07:02:36.761176 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:02:36.761477 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:02:36.761481 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:02:36.761504 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 07:02:36.761798 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.761806 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.762849 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.762853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.764278 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:02:36.764291 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.765357 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.765363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:02:36.765521 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.765543 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 07:02:36.765617 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 07:02:36.765728 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"mutex_wait_us":4,"thread_start_us":262,"threads_started":1}
I20260812 07:02:36.766991 23970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00b68968e754e4fb5155824029db736" candidate_uuid: "964fe703882244e091b6ed9de25e0caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e74066baf68440dabe00e80ca3b6c148" is_pre_election: true
I20260812 07:02:36.766985 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00b68968e754e4fb5155824029db736" candidate_uuid: "964fe703882244e091b6ed9de25e0caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e4178270274579b4f0d449d7ca8ebb" is_pre_election: true
I20260812 07:02:36.767495 23448 raft_consensus.cc:2454] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 964fe703882244e091b6ed9de25e0caf in term 0.
I20260812 07:02:36.767495 23970 raft_consensus.cc:2454] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 964fe703882244e091b6ed9de25e0caf in term 0.
I20260812 07:02:36.768194 23571 leader_election.cc:302] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e4178270274579b4f0d449d7ca8ebb, 964fe703882244e091b6ed9de25e0caf; no voters:
I20260812 07:02:36.768517 24118 raft_consensus.cc:2781] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 07:02:36.768661 24118 raft_consensus.cc:482] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 07:02:36.768774 24118 raft_consensus.cc:3037] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:36.770880 24118 raft_consensus.cc:504] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "964fe703882244e091b6ed9de25e0caf" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34403 } } peers { permanent_uuid: "e74066baf68440dabe00e80ca3b6c148" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 41575 } } peers { permanent_uuid: "31e4178270274579b4f0d449d7ca8ebb" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 34563 } }
I20260812 07:02:36.771411 24118 leader_election.cc:288] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [CANDIDATE]: Term 1 election: Requested vote from peers e74066baf68440dabe00e80ca3b6c148 (127.18.70.131:41575), 31e4178270274579b4f0d449d7ca8ebb (127.18.70.129:34563)
I20260812 07:02:36.771762 23970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00b68968e754e4fb5155824029db736" candidate_uuid: "964fe703882244e091b6ed9de25e0caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e74066baf68440dabe00e80ca3b6c148"
I20260812 07:02:36.771852 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00b68968e754e4fb5155824029db736" candidate_uuid: "964fe703882244e091b6ed9de25e0caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e4178270274579b4f0d449d7ca8ebb"
I20260812 07:02:36.771932 23970 raft_consensus.cc:3037] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:36.772027 23448 raft_consensus.cc:3037] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:36.774025 23970 raft_consensus.cc:2454] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 964fe703882244e091b6ed9de25e0caf in term 1.
I20260812 07:02:36.774137 23448 raft_consensus.cc:2454] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 964fe703882244e091b6ed9de25e0caf in term 1.
I20260812 07:02:36.774358 23571 leader_election.cc:302] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 964fe703882244e091b6ed9de25e0caf, e74066baf68440dabe00e80ca3b6c148; no voters:
I20260812 07:02:36.774609 24118 raft_consensus.cc:2781] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:36.774994 24118 raft_consensus.cc:686] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 1 LEADER]: Becoming Leader. State: Replica: 964fe703882244e091b6ed9de25e0caf, State: Running, Role: LEADER
I20260812 07:02:36.775391 24118 consensus_queue.cc:237] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "964fe703882244e091b6ed9de25e0caf" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34403 } } peers { permanent_uuid: "e74066baf68440dabe00e80ca3b6c148" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 41575 } } peers { permanent_uuid: "31e4178270274579b4f0d449d7ca8ebb" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 34563 } }
I20260812 07:02:36.779414 23189 catalog_manager.cc:5495] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf reported cstate change: term changed from 0 to 1, leader changed from <none> to 964fe703882244e091b6ed9de25e0caf (127.18.70.130). New cstate: current_term: 1 leader_uuid: "964fe703882244e091b6ed9de25e0caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "964fe703882244e091b6ed9de25e0caf" member_type: VOTER last_known_addr { host: "127.18.70.130" port: 34403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e74066baf68440dabe00e80ca3b6c148" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 41575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e4178270274579b4f0d449d7ca8ebb" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 34563 } health_report { overall_health: UNKNOWN } } }
I20260812 07:02:36.811592 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.806935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39168 (local address 127.18.70.130:34403)
0812 07:02:36.807125 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:36.807131 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:36.807221 (+ 90us) server_negotiation.cc:407] Connection header received
0812 07:02:36.807390 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:36.807394 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:36.807477 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:36.807587 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:02:36.807854 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.808509 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.809786 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.810238 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.810326 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.810707 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:02:36.811124 (+ 417us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:02:36.811227 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:36.811270 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 07:02:36.811327 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 07:02:36.818850 23448 raft_consensus.cc:1261] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb [term 1 FOLLOWER]: Refusing update from remote peer 964fe703882244e091b6ed9de25e0caf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:36.818858 23970 raft_consensus.cc:1261] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148 [term 1 FOLLOWER]: Refusing update from remote peer 964fe703882244e091b6ed9de25e0caf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:02:36.819671 24127 consensus_queue.cc:1035] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e74066baf68440dabe00e80ca3b6c148" member_type: VOTER last_known_addr { host: "127.18.70.131" port: 41575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:36.820009 24118 consensus_queue.cc:1035] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e4178270274579b4f0d449d7ca8ebb" member_type: VOTER last_known_addr { host: "127.18.70.129" port: 34563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:02:36.831749 24139 mvcc.cc:205] Tried to move back new op lower bound from 7317578370320773120 to 7317578370155159552. Current Snapshot: MvccSnapshot[applied={T|T < 7317578370320773120}]
I20260812 07:02:36.843729 23189 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:36.843941 23189 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 07:02:36.847178 23189 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05502e7bd618455fb2185e9ce6f05200: Sending DeleteTablet for 3 replicas of tablet b00b68968e754e4fb5155824029db736
I20260812 07:02:36.848130 23652 tablet_service.cc:1514] Processing DeleteTablet for tablet b00b68968e754e4fb5155824029db736 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:36 UTC) from {username='slave'} at 127.0.0.1:39166
I20260812 07:02:36.848325 23413 tablet_service.cc:1514] Processing DeleteTablet for tablet b00b68968e754e4fb5155824029db736 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:36 UTC) from {username='slave'} at 127.0.0.1:51234
I20260812 07:02:36.848331 23922 tablet_service.cc:1514] Processing DeleteTablet for tablet b00b68968e754e4fb5155824029db736 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 07:02:36 UTC) from {username='slave'} at 127.0.0.1:39994
I20260812 07:02:36.849360 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 23295
I20260812 07:02:36.857239 24160 tablet_replica.cc:330] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148: stopping tablet replica
I20260812 07:02:36.857771 24156 tablet_replica.cc:330] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf: stopping tablet replica
I20260812 07:02:36.858294 24156 raft_consensus.cc:2229] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 1 LEADER]: Raft consensus shutting down.
I20260812 07:02:36.858747 24160 raft_consensus.cc:2229] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:02:36.859221 24160 raft_consensus.cc:2258] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:36.859884 24156 raft_consensus.cc:2258] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:36.860809 24157 tablet_replica.cc:330] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb: stopping tablet replica
I20260812 07:02:36.861215 24157 raft_consensus.cc:2229] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 07:02:36.861721 24157 raft_consensus.cc:2258] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 07:02:36.862026 24156 ts_tablet_manager.cc:1905] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:36.862071 24160 ts_tablet_manager.cc:1905] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:36.863857 24157 ts_tablet_manager.cc:1905] T b00b68968e754e4fb5155824029db736 P 31e4178270274579b4f0d449d7ca8ebb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 07:02:36.865048 24107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.850803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51250 (local address 127.18.70.129:34563)
0812 07:02:36.851004 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:36.851011 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:36.856966 (+ 5955us) server_negotiation.cc:407] Connection header received
0812 07:02:36.857309 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:36.857315 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:36.857424 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:36.857499 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:36.858185 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.859332 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.861087 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.861795 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.861904 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.863387 (+ 1483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:36.863398 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:36.863411 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:36.864151 (+ 740us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:36.864213 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:36.864237 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:36.864319 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:36.864586 (+ 267us) server_negotiation.cc:299] Negotiation successful
0812 07:02:36.864693 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 07:02:36.866320 23526 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:36.869648 24156 ts_tablet_manager.cc:1918] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:36.869812 24156 log.cc:1196] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-1/wal/wals/b00b68968e754e4fb5155824029db736
I20260812 07:02:36.870378 24156 ts_tablet_manager.cc:1939] T b00b68968e754e4fb5155824029db736 P 964fe703882244e091b6ed9de25e0caf: Deleting consensus metadata
I20260812 07:02:36.873351 24160 ts_tablet_manager.cc:1918] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 07:02:36.873564 23170 catalog_manager.cc:4841] TS 964fe703882244e091b6ed9de25e0caf (127.18.70.130:34403): tablet b00b68968e754e4fb5155824029db736 (table test-table [id=d6d3f64d76d84212b55b80b2c718c31b]) successfully deleted
I20260812 07:02:36.873780 24160 log.cc:1196] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148: Deleting WAL directory at /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786517832212618-18714-0/minicluster-data/ts-2/wal/wals/b00b68968e754e4fb5155824029db736
I20260812 07:02:36.874284 24160 ts_tablet_manager.cc:1939] T b00b68968e754e4fb5155824029db736 P e74066baf68440dabe00e80ca3b6c148: Deleting consensus metadata
I20260812 07:02:36.875838 23170 catalog_manager.cc:4841] TS e74066baf68440dabe00e80ca3b6c148 (127.18.70.131:41575): tablet b00b68968e754e4fb5155824029db736 (table test-table [id=d6d3f64d76d84212b55b80b2c718c31b]) successfully deleted
I20260812 07:02:36.955713 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 23295
I20260812 07:02:36.988588 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 23539
W20260812 07:02:36.988714 23170 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.70.129:34563 (error 108)
I20260812 07:02:36.991196 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.990674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:34563 (local address 127.0.0.1:51262)
0812 07:02:36.990896 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:36.991023 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:34563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260812 07:02:36.991463 23170 catalog_manager.cc:4584] TS 31e4178270274579b4f0d449d7ca8ebb (127.18.70.129:34563): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b00b68968e754e4fb5155824029db736: Network error: Client connection negotiation failed: client connection to 127.18.70.129:34563: connect: Connection refused (error 111)
I20260812 07:02:36.996382 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:36.989443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39182 (local address 127.18.70.130:34403)
0812 07:02:36.989633 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:36.989638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:36.989661 (+ 23us) server_negotiation.cc:407] Connection header received
0812 07:02:36.989734 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:36.989740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:36.989880 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:36.990016 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:36.990475 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.991559 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.993432 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:36.993876 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:36.994004 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:36.995051 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:36.995059 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:36.995073 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:36.995673 (+ 600us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:36.995722 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:36.995747 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:36.995820 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:36.995979 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 07:02:36.996056 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 07:02:36.997044 23779 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:37.045015 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:37.044481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:34563 (local address 127.0.0.1:51274)
0812 07:02:37.044710 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:37.044817 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:34563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 07:02:37.046084 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:37.045672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:34563 (local address 127.0.0.1:51278)
0812 07:02:37.045835 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:37.045950 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:34563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 07:02:37.105007 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 23539
I20260812 07:02:37.109717 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:37.109159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:34563 (local address 127.0.0.1:51294)
0812 07:02:37.109404 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:37.109520 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:34563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 07:02:37.110899 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:37.110545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:34563 (local address 127.0.0.1:51308)
0812 07:02:37.110685 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:37.110762 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:34563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 07:02:37.132081 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 23800
I20260812 07:02:37.141234 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:37.132794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40008 (local address 127.18.70.131:41575)
0812 07:02:37.132959 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:37.132964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:37.132981 (+ 17us) server_negotiation.cc:407] Connection header received
0812 07:02:37.133129 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:37.133133 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:37.133212 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:37.133320 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:37.133731 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:37.134503 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:37.135719 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:37.136123 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:37.136231 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:37.139929 (+ 3698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:37.139939 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:37.139954 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:37.140535 (+ 581us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:37.140580 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:37.140602 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:37.140709 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:37.140842 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 07:02:37.140950 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 07:02:37.141808 24055 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:37.191176 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:37.190748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:34563 (local address 127.0.0.1:51310)
0812 07:02:37.190931 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:37.191022 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:34563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 07:02:37.192231 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:37.191822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.129:34563 (local address 127.0.0.1:51320)
0812 07:02:37.192041 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 07:02:37.192115 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.129:34563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260812 07:02:37.237998 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 23800
I20260812 07:02:37.264832 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 23136
I20260812 07:02:37.266011 23247 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:37.372632 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 23136
2026-08-12T07:02:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2659 ms)
[----------] 6 tests from EncryptionPolicyTest (21667 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:37 dist-test-slave-tc2s krb5kdc[24174](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:37 dist-test-slave-tc2s krb5kdc[24174](info): set up 2 sockets
Aug 12 07:02:37 dist-test-slave-tc2s krb5kdc[24174](info): commencing operation
krb5kdc: starting...
W20260812 07:02:38.645421 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.002s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:38 dist-test-slave-tc2s krb5kdc[24174](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:02:38.894495 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43669
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43669
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:39.216382 24206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:39.216661 24206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:39.216799 24206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:39.223829 24206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:39.223938 24206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:39.224012 24206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:39.224094 24206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:39.224151 24206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:39.233407 24206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43669
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:39.234576 24206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:39.235743 24206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:39.246505 24214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:39.246556 24213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:39.246582 24218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:39.247534 24206 server_base.cc:1034] running on GCE node
I20260812 07:02:39.248219 24206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:39.249456 24206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:39.250643 24206 hybrid_clock.cc:648] HybridClock initialized: now 1786518159250602 us; error 33 us; skew 500 ppm
I20260812 07:02:39.250962 24206 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:39 dist-test-slave-tc2s krb5kdc[24174](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518159, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:39.253856 24206 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:02:39.255216 24206 webserver.cc:460] Webserver started at http://127.0.0.1:33263/ using document root <none> and password file <none>
I20260812 07:02:39.255784 24206 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:39.255885 24206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:39.256119 24206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:39.258889 24206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "87de92e829d6479382a8a0992917506c"
format_stamp: "Formatted at 2026-08-12 07:02:39 on dist-test-slave-tc2s"
server_key: "0b232bf9dfb93fc2b4954e70a1fc35dd"
server_key_iv: "dcc01ffde315241aead59f2c40723971"
server_key_version: "encryptionkey@0"
I20260812 07:02:39.259581 24206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "87de92e829d6479382a8a0992917506c"
format_stamp: "Formatted at 2026-08-12 07:02:39 on dist-test-slave-tc2s"
server_key: "0b232bf9dfb93fc2b4954e70a1fc35dd"
server_key_iv: "dcc01ffde315241aead59f2c40723971"
server_key_version: "encryptionkey@0"
I20260812 07:02:39.264262 24206 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 07:02:39.267470 24229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:39.268711 24206 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 07:02:39.268860 24206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "87de92e829d6479382a8a0992917506c"
format_stamp: "Formatted at 2026-08-12 07:02:39 on dist-test-slave-tc2s"
server_key: "0b232bf9dfb93fc2b4954e70a1fc35dd"
server_key_iv: "dcc01ffde315241aead59f2c40723971"
server_key_version: "encryptionkey@0"
I20260812 07:02:39.269032 24206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:39.280984 24206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:39.284449 24206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:39.284701 24206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:39.301496 24206 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43669
I20260812 07:02:39.301529 24342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43669 every 8 connection(s)
I20260812 07:02:39.302727 24206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:39.305182 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 24206
I20260812 07:02:39.305390 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:39.306075 18714 external_mini_cluster.cc:1428] Setting key 210901d3f59315e89ebf645a8bd61ff7
I20260812 07:02:39.306216 24343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:39.319977 24343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c: Bootstrap starting.
Aug 12 07:02:39 dist-test-slave-tc2s krb5kdc[24174](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 07:02:39.323165 24343 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:39.324211 24343 log.cc:824] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:39.326763 24343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c: No bootstrap required, opened a new log
I20260812 07:02:39.328277 24356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:39.307829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56079 (local address 127.0.0.1:43669)
0812 07:02:39.308556 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:39.308566 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:39.308609 (+ 43us) server_negotiation.cc:407] Connection header received
0812 07:02:39.310560 (+ 1951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:39.310580 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:39.310945 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:39.311243 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:39.313011 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:39.314310 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:39.316024 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:39.316679 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:39.316812 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:39.321526 (+ 4714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:39.321533 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:39.321545 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:39.321582 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:39.324507 (+ 2925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:39.325219 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:39.325225 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:39.325231 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:39.325392 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:39.325826 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:39.325830 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:39.325832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:39.326331 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:39.326629 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:39.327113 (+ 484us) server_negotiation.cc:299] Negotiation successful
0812 07:02:39.327411 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":334,"threads_started":1}
I20260812 07:02:39.331866 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:02:39.334457 24343 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87de92e829d6479382a8a0992917506c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43669 } }
I20260812 07:02:39.334822 24343 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:39.334921 24343 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87de92e829d6479382a8a0992917506c, State: Initialized, Role: FOLLOWER
I20260812 07:02:39.336210 24343 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87de92e829d6479382a8a0992917506c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43669 } }
I20260812 07:02:39.336486 24343 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:39.336623 24343 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:39.336807 24343 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:39.339753 24343 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87de92e829d6479382a8a0992917506c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43669 } }
I20260812 07:02:39.340224 24343 leader_election.cc:302] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87de92e829d6479382a8a0992917506c; no voters:
I20260812 07:02:39.340840 24343 leader_election.cc:288] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:39.340934 24368 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:39.342855 24368 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [term 1 LEADER]: Becoming Leader. State: Replica: 87de92e829d6479382a8a0992917506c, State: Running, Role: LEADER
I20260812 07:02:39.343014 24343 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:39.343451 24368 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87de92e829d6479382a8a0992917506c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43669 } }
I20260812 07:02:39.349509 24374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87de92e829d6479382a8a0992917506c. Latest consensus state: current_term: 1 leader_uuid: "87de92e829d6479382a8a0992917506c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87de92e829d6479382a8a0992917506c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43669 } } }
I20260812 07:02:39.349910 24374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:39.350737 24370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87de92e829d6479382a8a0992917506c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87de92e829d6479382a8a0992917506c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43669 } } }
I20260812 07:02:39.351043 24370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:39.352356 24356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:39.336416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44295 (local address 127.0.0.1:43669)
0812 07:02:39.336547 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:39.336550 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:39.337146 (+ 596us) server_negotiation.cc:407] Connection header received
0812 07:02:39.337323 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:39.337326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:39.337387 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:39.337468 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:39.339199 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:39.339935 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:39.341288 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:39.341980 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:39.342062 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:39.344861 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:39.344873 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:39.344882 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:39.344918 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:39.348077 (+ 3159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:39.349033 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:39.349038 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:39.349041 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:39.349174 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:39.349749 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:39.349754 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:39.349756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:39.350189 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:39.350480 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:39.351766 (+ 1286us) server_negotiation.cc:299] Negotiation successful
0812 07:02:39.351974 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 07:02:39.357605 24392 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:39.362799 24392 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:39.371435 24392 catalog_manager.cc:1347] Generated new cluster ID: 7dc41c03f1594c1183d9522b0631cb24
I20260812 07:02:39.371548 24392 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:39.379453 24392 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:39.380595 24392 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:39.399369 24392 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87de92e829d6479382a8a0992917506c: Generated new TSK 0
I20260812 07:02:39.400081 24392 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:39.410951 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24206
I20260812 07:02:39.414203 24336 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:39.504454 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 24206
W20260812 07:02:39.526875 24172 connection.cc:535] client connection to 127.0.0.1:43669 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43669): Connection reset by peer (error 104)
2026-08-12T07:02:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2123 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:39 dist-test-slave-tc2s krb5kdc[24424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:39 dist-test-slave-tc2s krb5kdc[24424](info): set up 2 sockets
Aug 12 07:02:39 dist-test-slave-tc2s krb5kdc[24424](info): commencing operation
krb5kdc: starting...
W20260812 07:02:40.767122 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.003s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:40 dist-test-slave-tc2s krb5kdc[24424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:02:41.010905 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42049
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:41.343866 24445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:41.344125 24445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:41.344259 24445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:41.351481 24445 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:41.351591 24445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:41.351666 24445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:41.351743 24445 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:41.351809 24445 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:41.361557 24445 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42049
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:41.362752 24445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:41.364017 24445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:41.375066 24456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:41.375159 24457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:41.375159 24461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:41.375960 24445 server_base.cc:1034] running on GCE node
I20260812 07:02:41.376746 24445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:41.378034 24445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:41.379222 24445 hybrid_clock.cc:648] HybridClock initialized: now 1786518161379180 us; error 35 us; skew 500 ppm
I20260812 07:02:41.379531 24445 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:41 dist-test-slave-tc2s krb5kdc[24424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518161, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:41.382541 24445 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:02:41.383827 24445 webserver.cc:460] Webserver started at http://127.0.0.1:35567/ using document root <none> and password file <none>
I20260812 07:02:41.384430 24445 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:41.384527 24445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:41.384763 24445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:41.387564 24445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "8e8f03c34f6844c5961a387d43f1c090"
format_stamp: "Formatted at 2026-08-12 07:02:41 on dist-test-slave-tc2s"
server_key: "b7121bc34c6df0f3400cc0ddae3422cc"
server_key_iv: "f787cd9613f6680f678105c6c2494b9b"
server_key_version: "encryptionkey@0"
I20260812 07:02:41.388268 24445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "8e8f03c34f6844c5961a387d43f1c090"
format_stamp: "Formatted at 2026-08-12 07:02:41 on dist-test-slave-tc2s"
server_key: "b7121bc34c6df0f3400cc0ddae3422cc"
server_key_iv: "f787cd9613f6680f678105c6c2494b9b"
server_key_version: "encryptionkey@0"
I20260812 07:02:41.392966 24445 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 07:02:41.396109 24476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:41.397276 24445 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 07:02:41.397424 24445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "8e8f03c34f6844c5961a387d43f1c090"
format_stamp: "Formatted at 2026-08-12 07:02:41 on dist-test-slave-tc2s"
server_key: "b7121bc34c6df0f3400cc0ddae3422cc"
server_key_iv: "f787cd9613f6680f678105c6c2494b9b"
server_key_version: "encryptionkey@0"
I20260812 07:02:41.397588 24445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:41.414042 24445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:41.417689 24445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:41.418018 24445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:41.435019 24445 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42049
I20260812 07:02:41.435087 24571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42049 every 8 connection(s)
I20260812 07:02:41.436254 24445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:41.439769 24573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:41.445159 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 24445
I20260812 07:02:41.445329 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:41.445756 18714 external_mini_cluster.cc:1428] Setting key 9d3831e96647dad96a26eaf7841e08e6
I20260812 07:02:41.450134 24573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090: Bootstrap starting.
I20260812 07:02:41.453459 24573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:41.454660 24573 log.cc:824] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:41.457260 24573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090: No bootstrap required, opened a new log
I20260812 07:02:41.458412 24578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:41.447363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47587 (local address 127.0.0.1:42049)
0812 07:02:41.448186 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:41.448197 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:41.448237 (+ 40us) server_negotiation.cc:407] Connection header received
0812 07:02:41.449861 (+ 1624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:41.449881 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:41.450272 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:41.450610 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:41.451154 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:41.452408 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:41.454281 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:41.455004 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:41.455194 (+ 190us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:41.456280 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:41.456287 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:41.456300 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:41.456797 (+ 497us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:41.456874 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:41.456898 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:41.457031 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:41.457322 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 07:02:41.457473 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":364,"threads_started":1}
I20260812 07:02:41.462169 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:02:41.465142 24573 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e8f03c34f6844c5961a387d43f1c090" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260812 07:02:41.465467 24573 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:41.465560 24573 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e8f03c34f6844c5961a387d43f1c090, State: Initialized, Role: FOLLOWER
I20260812 07:02:41.466100 24573 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e8f03c34f6844c5961a387d43f1c090" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260812 07:02:41.466392 24573 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:41.466584 24573 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:41.466769 24573 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:41.469584 24573 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e8f03c34f6844c5961a387d43f1c090" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260812 07:02:41.470142 24573 leader_election.cc:302] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e8f03c34f6844c5961a387d43f1c090; no voters:
I20260812 07:02:41.470780 24573 leader_election.cc:288] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:41.470937 24589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:41.471819 24589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [term 1 LEADER]: Becoming Leader. State: Replica: 8e8f03c34f6844c5961a387d43f1c090, State: Running, Role: LEADER
I20260812 07:02:41.472407 24589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e8f03c34f6844c5961a387d43f1c090" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260812 07:02:41.472913 24573 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:41.473284 24578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:41.466375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49505 (local address 127.0.0.1:42049)
0812 07:02:41.466563 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:41.466574 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:41.466979 (+ 405us) server_negotiation.cc:407] Connection header received
0812 07:02:41.467167 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:41.467170 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:41.467225 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:41.467303 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:41.467866 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:41.468641 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:41.470438 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:41.471098 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:41.471229 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:41.472521 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:41.472526 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:41.472529 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:41.472544 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:41.472606 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:41.472627 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:41.472729 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:41.472963 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 07:02:41.473012 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 07:02:41.475244 24590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e8f03c34f6844c5961a387d43f1c090" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e8f03c34f6844c5961a387d43f1c090" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } } }
I20260812 07:02:41.475623 24590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:41.476311 24594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e8f03c34f6844c5961a387d43f1c090. Latest consensus state: current_term: 1 leader_uuid: "8e8f03c34f6844c5961a387d43f1c090" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e8f03c34f6844c5961a387d43f1c090" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } } }
I20260812 07:02:41.476752 24594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090 [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:41.482838 24608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:41.487425 24608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:41.495868 24608 catalog_manager.cc:1347] Generated new cluster ID: 79f02a789cf040a09169567abd261df3
I20260812 07:02:41.495957 24608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:41.517154 24608 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:41.518368 24608 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:41.526607 24608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e8f03c34f6844c5961a387d43f1c090: Generated new TSK 0
I20260812 07:02:41.527314 24608 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:41.537148 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24445
W20260812 07:02:41.538276 24564 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47587
W20260812 07:02:41.538962 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24445: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:02:41.539125 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 24445
W20260812 07:02:41.565049 24414 connection.cc:535] client connection to 127.0.0.1:42049 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42049): Connection reset by peer (error 104)
2026-08-12T07:02:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2037 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:41 dist-test-slave-tc2s krb5kdc[24631](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:41 dist-test-slave-tc2s krb5kdc[24631](info): set up 2 sockets
Aug 12 07:02:41 dist-test-slave-tc2s krb5kdc[24631](info): commencing operation
krb5kdc: starting...
W20260812 07:02:42.802201 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.004s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:42 dist-test-slave-tc2s krb5kdc[24631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:02:43.048691 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35273
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35273
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:43.369961 24659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:43.370205 24659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:43.370332 24659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:43.377211 24659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:43.377300 24659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:43.377379 24659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:43.377454 24659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:43.377512 24659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:43.387269 24659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35273
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:43.388353 24659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:43.389532 24659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:43.400233 24670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:43.400238 24671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:43.400321 24674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:43.401206 24659 server_base.cc:1034] running on GCE node
I20260812 07:02:43.401937 24659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:43.403119 24659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:43.404325 24659 hybrid_clock.cc:648] HybridClock initialized: now 1786518163404266 us; error 37 us; skew 500 ppm
I20260812 07:02:43.404711 24659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:43 dist-test-slave-tc2s krb5kdc[24631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518163, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:43.410902 24659 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:02:43.412269 24659 webserver.cc:460] Webserver started at http://127.0.0.1:37373/ using document root <none> and password file <none>
I20260812 07:02:43.412889 24659 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:43.413018 24659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:43.413298 24659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:43.416149 24659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "2831de971c4f44cfaaec50bcaf969e7a"
format_stamp: "Formatted at 2026-08-12 07:02:43 on dist-test-slave-tc2s"
server_key: "533e6c8b9b0ea230ec9f9a4f1fc97766"
server_key_iv: "b1dd1fb467af6b1e9a725f2d36f15a43"
server_key_version: "encryptionkey@0"
I20260812 07:02:43.416878 24659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "2831de971c4f44cfaaec50bcaf969e7a"
format_stamp: "Formatted at 2026-08-12 07:02:43 on dist-test-slave-tc2s"
server_key: "533e6c8b9b0ea230ec9f9a4f1fc97766"
server_key_iv: "b1dd1fb467af6b1e9a725f2d36f15a43"
server_key_version: "encryptionkey@0"
I20260812 07:02:43.421615 24659 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.005s
I20260812 07:02:43.424794 24696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:43.425971 24659 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260812 07:02:43.426122 24659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "2831de971c4f44cfaaec50bcaf969e7a"
format_stamp: "Formatted at 2026-08-12 07:02:43 on dist-test-slave-tc2s"
server_key: "533e6c8b9b0ea230ec9f9a4f1fc97766"
server_key_iv: "b1dd1fb467af6b1e9a725f2d36f15a43"
server_key_version: "encryptionkey@0"
I20260812 07:02:43.426290 24659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:43.431520 24659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:43.435045 24659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:43.435294 24659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:43.451563 24659 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35273
I20260812 07:02:43.451617 24792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35273 every 8 connection(s)
I20260812 07:02:43.452781 24659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:43.456198 24794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:43.460408 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 24659
I20260812 07:02:43.460587 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:43.461120 18714 external_mini_cluster.cc:1428] Setting key 791446a1b124881ac6b5b06535e35d4c
I20260812 07:02:43.467126 24794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a: Bootstrap starting.
I20260812 07:02:43.468712 24801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:43.462829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58739 (local address 127.0.0.1:35273)
0812 07:02:43.463534 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:43.463546 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:43.463586 (+ 40us) server_negotiation.cc:407] Connection header received
0812 07:02:43.465677 (+ 2091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:43.465698 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:43.466034 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:43.466317 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:43.467277 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:43.467283 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:43.467295 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:43.467310 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:43.467370 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:43.467393 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:43.467556 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:43.467686 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 07:02:43.467841 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":298,"threads_started":1}
I20260812 07:02:43.470292 24794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:43.471480 24794 log.cc:824] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:43.472249 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:02:43.474349 24794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a: No bootstrap required, opened a new log
I20260812 07:02:43.479401 24801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:43.477213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34865 (local address 127.0.0.1:35273)
0812 07:02:43.477344 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:43.477351 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:43.477688 (+ 337us) server_negotiation.cc:407] Connection header received
0812 07:02:43.477823 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:43.477827 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:43.477871 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:43.477989 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:43.478812 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:43.478816 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:43.478819 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:43.478832 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:43.478866 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:43.478880 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:43.478972 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:43.479088 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 07:02:43.479134 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 07:02:43.482950 24794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2831de971c4f44cfaaec50bcaf969e7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35273 } }
I20260812 07:02:43.483278 24794 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:43.483384 24794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2831de971c4f44cfaaec50bcaf969e7a, State: Initialized, Role: FOLLOWER
I20260812 07:02:43.483940 24794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2831de971c4f44cfaaec50bcaf969e7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35273 } }
I20260812 07:02:43.484169 24794 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:43.484298 24794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:43.484457 24794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:43.486582 24794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2831de971c4f44cfaaec50bcaf969e7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35273 } }
I20260812 07:02:43.487021 24794 leader_election.cc:302] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2831de971c4f44cfaaec50bcaf969e7a; no voters:
I20260812 07:02:43.487519 24794 leader_election.cc:288] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:43.487637 24813 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:43.488245 24813 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [term 1 LEADER]: Becoming Leader. State: Replica: 2831de971c4f44cfaaec50bcaf969e7a, State: Running, Role: LEADER
I20260812 07:02:43.488741 24813 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2831de971c4f44cfaaec50bcaf969e7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35273 } }
I20260812 07:02:43.489363 24794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:43.491689 24817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2831de971c4f44cfaaec50bcaf969e7a. Latest consensus state: current_term: 1 leader_uuid: "2831de971c4f44cfaaec50bcaf969e7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2831de971c4f44cfaaec50bcaf969e7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35273 } } }
I20260812 07:02:43.492154 24817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:43.492758 24814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2831de971c4f44cfaaec50bcaf969e7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2831de971c4f44cfaaec50bcaf969e7a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35273 } } }
I20260812 07:02:43.493037 24814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:43.493813 24825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:43.498358 24825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:43.506479 24825 catalog_manager.cc:1347] Generated new cluster ID: fdb587adfdab467d96ed749e9c093056
I20260812 07:02:43.506580 24825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:43.524566 24825 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:43.524945 24825 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:43.537262 24825 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2831de971c4f44cfaaec50bcaf969e7a: Generated new TSK 0
I20260812 07:02:43.538161 24825 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:43.550134 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24659
W20260812 07:02:43.551796 24783 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58739
W20260812 07:02:43.552457 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24659: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:02:43.552601 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 24659
2026-08-12T07:02:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2008 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:43 dist-test-slave-tc2s krb5kdc[24850](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:43 dist-test-slave-tc2s krb5kdc[24850](info): set up 2 sockets
Aug 12 07:02:43 dist-test-slave-tc2s krb5kdc[24850](info): commencing operation
krb5kdc: starting...
W20260812 07:02:44.807096 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.214s user 0.001s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:44 dist-test-slave-tc2s krb5kdc[24850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:02:45.064723 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36439
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:45.399469 24880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:45.399747 24880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:45.399883 24880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:45.407068 24880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:45.407181 24880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:45.407261 24880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:45.407343 24880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:45.407436 24880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:45.418488 24880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36439
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:45.419704 24880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:45.420930 24880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:45.432170 24892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:45.432286 24889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:45.432331 24894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:45.432932 24880 server_base.cc:1034] running on GCE node
I20260812 07:02:45.433686 24880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:45.435029 24880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:45.436230 24880 hybrid_clock.cc:648] HybridClock initialized: now 1786518165436182 us; error 40 us; skew 500 ppm
I20260812 07:02:45.436547 24880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:45 dist-test-slave-tc2s krb5kdc[24850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518165, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:45.439574 24880 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:02:45.440975 24880 webserver.cc:460] Webserver started at http://127.0.0.1:33119/ using document root <none> and password file <none>
I20260812 07:02:45.441574 24880 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:45.441670 24880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:45.441953 24880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:45.444923 24880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "dfae59f1a79b4d2eb7ea6493775ba8be"
format_stamp: "Formatted at 2026-08-12 07:02:45 on dist-test-slave-tc2s"
server_key: "f67c64708f11abcdd759e1abfa4cd1e8"
server_key_iv: "c9efeda9389fb2972684861f39b5fd73"
server_key_version: "encryptionkey@0"
I20260812 07:02:45.445667 24880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "dfae59f1a79b4d2eb7ea6493775ba8be"
format_stamp: "Formatted at 2026-08-12 07:02:45 on dist-test-slave-tc2s"
server_key: "f67c64708f11abcdd759e1abfa4cd1e8"
server_key_iv: "c9efeda9389fb2972684861f39b5fd73"
server_key_version: "encryptionkey@0"
I20260812 07:02:45.450484 24880 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 07:02:45.453708 24911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:45.454931 24880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:02:45.455071 24880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "dfae59f1a79b4d2eb7ea6493775ba8be"
format_stamp: "Formatted at 2026-08-12 07:02:45 on dist-test-slave-tc2s"
server_key: "f67c64708f11abcdd759e1abfa4cd1e8"
server_key_iv: "c9efeda9389fb2972684861f39b5fd73"
server_key_version: "encryptionkey@0"
I20260812 07:02:45.455232 24880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:45.469687 24880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:45.473124 24880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:45.473348 24880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:45.490437 24880 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36439
I20260812 07:02:45.490476 25018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36439 every 8 connection(s)
I20260812 07:02:45.491703 24880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:45.495146 25020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:45.500218 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 24880
I20260812 07:02:45.500406 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:45.500952 18714 external_mini_cluster.cc:1428] Setting key dc564e5aa53b81e7fd73cb81d066fbc2
I20260812 07:02:45.505854 25020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be: Bootstrap starting.
I20260812 07:02:45.508764 25020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:45.509689 25020 log.cc:824] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:45.512460 25020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be: No bootstrap required, opened a new log
Aug 12 07:02:45 dist-test-slave-tc2s krb5kdc[24850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 07:02:45.520382 25020 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfae59f1a79b4d2eb7ea6493775ba8be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36439 } }
I20260812 07:02:45.520735 25020 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:45.520831 25020 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfae59f1a79b4d2eb7ea6493775ba8be, State: Initialized, Role: FOLLOWER
I20260812 07:02:45.521433 25020 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfae59f1a79b4d2eb7ea6493775ba8be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36439 } }
I20260812 07:02:45.521721 25020 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:45.521865 25020 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:45.522064 25020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:45.522733 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:45.502679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57807 (local address 127.0.0.1:36439)
0812 07:02:45.503492 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:45.503506 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:45.503547 (+ 41us) server_negotiation.cc:407] Connection header received
0812 07:02:45.505206 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:45.505229 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:45.505584 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:45.505924 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:45.507419 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:45.508676 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:45.509962 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:45.510968 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:45.511133 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:45.515322 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:45.515330 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:45.515344 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:45.515381 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:45.518563 (+ 3182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:45.519244 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:45.519251 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:45.519256 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:45.519450 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:45.519843 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:45.519847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:45.519849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:45.520403 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:45.520696 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:45.521168 (+ 472us) server_negotiation.cc:299] Negotiation successful
0812 07:02:45.521579 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":360,"threads_started":1}
I20260812 07:02:45.524765 25020 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfae59f1a79b4d2eb7ea6493775ba8be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36439 } }
I20260812 07:02:45.525291 25020 leader_election.cc:302] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfae59f1a79b4d2eb7ea6493775ba8be; no voters:
I20260812 07:02:45.525938 25020 leader_election.cc:288] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:45.526088 25030 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:45.526513 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:02:45.527842 25020 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:45.532552 25030 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [term 1 LEADER]: Becoming Leader. State: Replica: dfae59f1a79b4d2eb7ea6493775ba8be, State: Running, Role: LEADER
I20260812 07:02:45.533111 25030 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfae59f1a79b4d2eb7ea6493775ba8be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36439 } }
I20260812 07:02:45.536119 25033 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfae59f1a79b4d2eb7ea6493775ba8be. Latest consensus state: current_term: 1 leader_uuid: "dfae59f1a79b4d2eb7ea6493775ba8be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfae59f1a79b4d2eb7ea6493775ba8be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36439 } } }
I20260812 07:02:45.536489 25033 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:45.536983 25032 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfae59f1a79b4d2eb7ea6493775ba8be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfae59f1a79b4d2eb7ea6493775ba8be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36439 } } }
I20260812 07:02:45.537281 25032 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be [sys.catalog]: This master's current role is: LEADER
W20260812 07:02:45.542742 25070 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 07:02:45.542860 25070 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 07:02:45.543013 25068 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:45.545269 25068 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:45.548396 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:45.534122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59491 (local address 127.0.0.1:36439)
0812 07:02:45.534292 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:45.534307 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:45.534876 (+ 569us) server_negotiation.cc:407] Connection header received
0812 07:02:45.535046 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:45.535052 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:45.535133 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:45.535245 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:45.537352 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:45.538380 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:45.539838 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:45.540290 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:45.540433 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:45.542737 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:45.542742 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:45.542745 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:45.542774 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:45.545745 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:45.546430 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:45.546436 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:45.546438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:45.546559 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:45.546937 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:45.546941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:45.546943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:45.547244 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:45.547455 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:45.547811 (+ 356us) server_negotiation.cc:299] Negotiation successful
0812 07:02:45.548043 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 07:02:45.553830 25068 catalog_manager.cc:1347] Generated new cluster ID: 12e27482dae34a7586b8d415ec45bcb4
I20260812 07:02:45.553942 25068 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:45.565145 25068 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:45.566805 25068 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:45.580732 25068 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfae59f1a79b4d2eb7ea6493775ba8be: Generated new TSK 0
I20260812 07:02:45.581418 25068 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:45.594993 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 24880
I20260812 07:02:45.595932 25013 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:45.684831 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 24880
2026-08-12T07:02:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2132 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:45 dist-test-slave-tc2s krb5kdc[25081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:45 dist-test-slave-tc2s krb5kdc[25081](info): set up 2 sockets
Aug 12 07:02:45 dist-test-slave-tc2s krb5kdc[25081](info): commencing operation
krb5kdc: starting...
W20260812 07:02:46.932441 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:47 dist-test-slave-tc2s krb5kdc[25081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:02:47.190551 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45595
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:47.522974 25113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:47.523260 25113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:47.523399 25113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:47.530421 25113 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:47.530543 25113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:47.530617 25113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:47.530700 25113 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:47.530759 25113 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:47.540267 25113 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:47.541512 25113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:47.542804 25113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:47.553954 25127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:47.554050 25132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:47.554381 25126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:47.554731 25113 server_base.cc:1034] running on GCE node
I20260812 07:02:47.555456 25113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:47.556700 25113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:47.557902 25113 hybrid_clock.cc:648] HybridClock initialized: now 1786518167557850 us; error 35 us; skew 500 ppm
I20260812 07:02:47.558226 25113 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:47 dist-test-slave-tc2s krb5kdc[25081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518167, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:47.561120 25113 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:02:47.562469 25113 webserver.cc:460] Webserver started at http://127.0.0.1:35917/ using document root <none> and password file <none>
I20260812 07:02:47.563102 25113 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:47.563215 25113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:47.563493 25113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:47.566393 25113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "a5954c18911c40f7a1665e5f7c237c9b"
format_stamp: "Formatted at 2026-08-12 07:02:47 on dist-test-slave-tc2s"
server_key: "9d314812c1df9e87339d247cdcb9f692"
server_key_iv: "e49afc8a487c914936ed94e91a75c094"
server_key_version: "encryptionkey@0"
I20260812 07:02:47.567126 25113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "a5954c18911c40f7a1665e5f7c237c9b"
format_stamp: "Formatted at 2026-08-12 07:02:47 on dist-test-slave-tc2s"
server_key: "9d314812c1df9e87339d247cdcb9f692"
server_key_iv: "e49afc8a487c914936ed94e91a75c094"
server_key_version: "encryptionkey@0"
I20260812 07:02:47.571862 25113 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 07:02:47.575059 25144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:47.576195 25113 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 07:02:47.576351 25113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "a5954c18911c40f7a1665e5f7c237c9b"
format_stamp: "Formatted at 2026-08-12 07:02:47 on dist-test-slave-tc2s"
server_key: "9d314812c1df9e87339d247cdcb9f692"
server_key_iv: "e49afc8a487c914936ed94e91a75c094"
server_key_version: "encryptionkey@0"
I20260812 07:02:47.576534 25113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:47.593542 25113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:47.597047 25113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:47.597293 25113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:47.614682 25113 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45595
I20260812 07:02:47.614714 25238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45595 every 8 connection(s)
I20260812 07:02:47.615911 25113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:47.619390 25240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:47.623824 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 25113
I20260812 07:02:47.623991 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:47.624435 18714 external_mini_cluster.cc:1428] Setting key b71b6238ebf5b4ad19b70e56f693dcb8
I20260812 07:02:47.629874 25240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b: Bootstrap starting.
I20260812 07:02:47.633297 25240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:47.634502 25240 log.cc:824] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:47.637275 25245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:47.626093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43541 (local address 127.0.0.1:45595)
0812 07:02:47.626816 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:47.626826 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:47.626871 (+ 45us) server_negotiation.cc:407] Connection header received
0812 07:02:47.628603 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:47.628624 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:47.628952 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:47.629241 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:47.629849 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:47.631193 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:47.633026 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:47.633709 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:47.633831 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:47.634968 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:47.634979 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:47.634997 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:47.635719 (+ 722us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:47.635809 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:47.635845 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:47.635927 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:47.636147 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 07:02:47.636370 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":329,"threads_started":1}
I20260812 07:02:47.637449 25240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b: No bootstrap required, opened a new log
I20260812 07:02:47.640681 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:02:47.646908 25240 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5954c18911c40f7a1665e5f7c237c9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45595 } }
I20260812 07:02:47.647336 25240 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:47.647454 25240 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5954c18911c40f7a1665e5f7c237c9b, State: Initialized, Role: FOLLOWER
I20260812 07:02:47.648097 25240 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5954c18911c40f7a1665e5f7c237c9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45595 } }
I20260812 07:02:47.648384 25240 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:47.648516 25240 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:47.648680 25240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:47.651467 25240 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5954c18911c40f7a1665e5f7c237c9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45595 } }
I20260812 07:02:47.652042 25240 leader_election.cc:302] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5954c18911c40f7a1665e5f7c237c9b; no voters:
I20260812 07:02:47.652310 25245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:47.645750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45491 (local address 127.0.0.1:45595)
0812 07:02:47.645944 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:47.645950 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:47.646444 (+ 494us) server_negotiation.cc:407] Connection header received
0812 07:02:47.646581 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:47.646586 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:47.646664 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:47.646771 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:47.647208 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:47.648262 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:47.649669 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:47.650374 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:47.650504 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:47.651506 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:47.651512 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:47.651517 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:47.651537 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:47.651585 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:47.651605 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:47.651695 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:47.651852 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 07:02:47.651967 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 07:02:47.652715 25240 leader_election.cc:288] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:47.652820 25254 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:47.654182 25254 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [term 1 LEADER]: Becoming Leader. State: Replica: a5954c18911c40f7a1665e5f7c237c9b, State: Running, Role: LEADER
I20260812 07:02:47.654664 25254 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5954c18911c40f7a1665e5f7c237c9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45595 } }
I20260812 07:02:47.654929 25240 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:47.657675 25261 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5954c18911c40f7a1665e5f7c237c9b. Latest consensus state: current_term: 1 leader_uuid: "a5954c18911c40f7a1665e5f7c237c9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5954c18911c40f7a1665e5f7c237c9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45595 } } }
I20260812 07:02:47.657753 25260 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5954c18911c40f7a1665e5f7c237c9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5954c18911c40f7a1665e5f7c237c9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45595 } } }
I20260812 07:02:47.658082 25261 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:47.658108 25260 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:47.660514 25274 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:47.665841 25274 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:47.674145 25274 catalog_manager.cc:1347] Generated new cluster ID: a93dd54b0fd04e8d809d1284a01c3756
I20260812 07:02:47.674257 25274 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:47.685029 25274 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:47.686805 25274 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:47.702225 25274 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5954c18911c40f7a1665e5f7c237c9b: Generated new TSK 0
I20260812 07:02:47.703186 25274 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:47.718626 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25113
W20260812 07:02:47.720127 25233 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43541
W20260812 07:02:47.720834 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25113: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:02:47.720973 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 25113
2026-08-12T07:02:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2039 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:47 dist-test-slave-tc2s krb5kdc[25298](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:47 dist-test-slave-tc2s krb5kdc[25298](info): set up 2 sockets
Aug 12 07:02:47 dist-test-slave-tc2s krb5kdc[25298](info): commencing operation
krb5kdc: starting...
W20260812 07:02:48.985747 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:49 dist-test-slave-tc2s krb5kdc[25298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:02:49.254876 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33213
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:49.587903 25317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:49.588171 25317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:49.588308 25317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:49.595427 25317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:49.595533 25317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:49.595608 25317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:49.595678 25317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:49.595737 25317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:49.605309 25317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:49.606496 25317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:49.607754 25317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:49.619004 25330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:49.619051 25337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:49.619073 25332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:49.619972 25317 server_base.cc:1034] running on GCE node
I20260812 07:02:49.620703 25317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:49.622026 25317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:49.623215 25317 hybrid_clock.cc:648] HybridClock initialized: now 1786518169623174 us; error 33 us; skew 500 ppm
I20260812 07:02:49.623545 25317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:49 dist-test-slave-tc2s krb5kdc[25298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518169, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:49.629796 25317 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:02:49.631201 25317 webserver.cc:460] Webserver started at http://127.0.0.1:40395/ using document root <none> and password file <none>
I20260812 07:02:49.631839 25317 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:49.631963 25317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:49.632238 25317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:49.635143 25317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "f5bf1a383d4c430996d4dc6fb7b4b655"
format_stamp: "Formatted at 2026-08-12 07:02:49 on dist-test-slave-tc2s"
server_key: "7d8d78fc15940bef0c7b6ed03b76332c"
server_key_iv: "eec3a7cf44939a1dab9ffbad2b5f2180"
server_key_version: "encryptionkey@0"
I20260812 07:02:49.635885 25317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "f5bf1a383d4c430996d4dc6fb7b4b655"
format_stamp: "Formatted at 2026-08-12 07:02:49 on dist-test-slave-tc2s"
server_key: "7d8d78fc15940bef0c7b6ed03b76332c"
server_key_iv: "eec3a7cf44939a1dab9ffbad2b5f2180"
server_key_version: "encryptionkey@0"
I20260812 07:02:49.640708 25317 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 07:02:49.644034 25356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:49.645260 25317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 07:02:49.645424 25317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "f5bf1a383d4c430996d4dc6fb7b4b655"
format_stamp: "Formatted at 2026-08-12 07:02:49 on dist-test-slave-tc2s"
server_key: "7d8d78fc15940bef0c7b6ed03b76332c"
server_key_iv: "eec3a7cf44939a1dab9ffbad2b5f2180"
server_key_version: "encryptionkey@0"
I20260812 07:02:49.645607 25317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:49.651113 25317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:49.654734 25317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:49.654996 25317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:49.672243 25317 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33213
I20260812 07:02:49.672302 25441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33213 every 8 connection(s)
I20260812 07:02:49.673540 25317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:49.677265 25444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:49.679869 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 25317
I20260812 07:02:49.680058 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:49.680667 18714 external_mini_cluster.cc:1428] Setting key 57a752d63fbe21c5265144fa115c1906
I20260812 07:02:49.689741 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:49.682594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54141 (local address 127.0.0.1:33213)
0812 07:02:49.683487 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:49.683503 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:49.683809 (+ 306us) server_negotiation.cc:407] Connection header received
0812 07:02:49.686069 (+ 2260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:49.686099 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:49.686527 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:49.686950 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:49.687916 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:49.687924 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:49.687940 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:49.687963 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:49.688034 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:49.688059 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:49.688281 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:49.688425 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 07:02:49.688606 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":370,"threads_started":1}
I20260812 07:02:49.690532 25444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655: Bootstrap starting.
I20260812 07:02:49.693066 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:02:49.693753 25444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:49.694751 25444 log.cc:824] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:49.697751 25444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655: No bootstrap required, opened a new log
I20260812 07:02:49.699542 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:49.697217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60275 (local address 127.0.0.1:33213)
0812 07:02:49.697362 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:49.697387 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:49.697753 (+ 366us) server_negotiation.cc:407] Connection header received
0812 07:02:49.697911 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:49.697916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:49.697968 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:49.698047 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:49.698922 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:49.698927 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:49.698932 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:49.698950 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:49.698988 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:49.699003 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:49.699096 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:49.699212 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 07:02:49.699277 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 07:02:49.705518 25444 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5bf1a383d4c430996d4dc6fb7b4b655" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33213 } }
I20260812 07:02:49.705874 25444 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:49.706012 25444 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5bf1a383d4c430996d4dc6fb7b4b655, State: Initialized, Role: FOLLOWER
I20260812 07:02:49.706509 25444 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5bf1a383d4c430996d4dc6fb7b4b655" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33213 } }
I20260812 07:02:49.706724 25444 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:49.706844 25444 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:49.706997 25444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:49.709055 25444 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5bf1a383d4c430996d4dc6fb7b4b655" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33213 } }
I20260812 07:02:49.709510 25444 leader_election.cc:302] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5bf1a383d4c430996d4dc6fb7b4b655; no voters:
I20260812 07:02:49.710052 25444 leader_election.cc:288] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:49.710162 25468 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:49.711490 25468 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [term 1 LEADER]: Becoming Leader. State: Replica: f5bf1a383d4c430996d4dc6fb7b4b655, State: Running, Role: LEADER
I20260812 07:02:49.712023 25444 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:49.711977 25468 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5bf1a383d4c430996d4dc6fb7b4b655" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33213 } }
I20260812 07:02:49.714814 25473 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5bf1a383d4c430996d4dc6fb7b4b655. Latest consensus state: current_term: 1 leader_uuid: "f5bf1a383d4c430996d4dc6fb7b4b655" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5bf1a383d4c430996d4dc6fb7b4b655" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33213 } } }
I20260812 07:02:49.714849 25472 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5bf1a383d4c430996d4dc6fb7b4b655" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5bf1a383d4c430996d4dc6fb7b4b655" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33213 } } }
I20260812 07:02:49.715287 25472 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:49.715287 25473 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655 [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:49.716951 25490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:49.722107 25490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:49.730134 25490 catalog_manager.cc:1347] Generated new cluster ID: 6ecddb3bb34849eb92d117e4cf86041d
I20260812 07:02:49.730237 25490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:49.770531 25490 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:49.770970 25490 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:49.782102 25490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5bf1a383d4c430996d4dc6fb7b4b655: Generated new TSK 0
I20260812 07:02:49.782938 25490 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:49.787984 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25317
W20260812 07:02:49.788960 25437 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54141
W20260812 07:02:49.789601 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25317: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:02:49.789726 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 25317
2026-08-12T07:02:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2062 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:49 dist-test-slave-tc2s krb5kdc[25519](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:49 dist-test-slave-tc2s krb5kdc[25519](info): set up 2 sockets
Aug 12 07:02:49 dist-test-slave-tc2s krb5kdc[25519](info): commencing operation
krb5kdc: starting...
W20260812 07:02:51.055641 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:51 dist-test-slave-tc2s krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:02:51.312491 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43121
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:51.644939 25540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:51.645210 25540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:51.645350 25540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:51.652319 25540 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:51.652437 25540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:51.652513 25540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:51.652594 25540 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:51.652652 25540 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:51.662015 25540 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43121
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:51.663174 25540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:51.664407 25540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:51.675437 25549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:51.675562 25554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:51.675606 25551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:51.676421 25540 server_base.cc:1034] running on GCE node
I20260812 07:02:51.677134 25540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:51.678436 25540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:51.679636 25540 hybrid_clock.cc:648] HybridClock initialized: now 1786518171679587 us; error 38 us; skew 500 ppm
I20260812 07:02:51.679962 25540 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:51 dist-test-slave-tc2s krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518171, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:51.683007 25540 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:02:51.684361 25540 webserver.cc:460] Webserver started at http://127.0.0.1:41443/ using document root <none> and password file <none>
I20260812 07:02:51.684983 25540 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:51.685107 25540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:51.685384 25540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:51.688241 25540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "f13a6fa2b2824fa6aecd4a1a419e7e21"
format_stamp: "Formatted at 2026-08-12 07:02:51 on dist-test-slave-tc2s"
server_key: "b764bcb640ee635afdf89defa29614ca"
server_key_iv: "960b8d04e798f755a66633451d0edc80"
server_key_version: "encryptionkey@0"
I20260812 07:02:51.688979 25540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "f13a6fa2b2824fa6aecd4a1a419e7e21"
format_stamp: "Formatted at 2026-08-12 07:02:51 on dist-test-slave-tc2s"
server_key: "b764bcb640ee635afdf89defa29614ca"
server_key_iv: "960b8d04e798f755a66633451d0edc80"
server_key_version: "encryptionkey@0"
I20260812 07:02:51.693714 25540 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260812 07:02:51.697042 25564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:51.698204 25540 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 07:02:51.698357 25540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "f13a6fa2b2824fa6aecd4a1a419e7e21"
format_stamp: "Formatted at 2026-08-12 07:02:51 on dist-test-slave-tc2s"
server_key: "b764bcb640ee635afdf89defa29614ca"
server_key_iv: "960b8d04e798f755a66633451d0edc80"
server_key_version: "encryptionkey@0"
I20260812 07:02:51.698524 25540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:51.717288 25540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:51.721170 25540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:51.721415 25540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:51.738075 25540 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43121
I20260812 07:02:51.738106 25668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43121 every 8 connection(s)
I20260812 07:02:51.739279 25540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:51.742681 25669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:51.745191 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 25540
I20260812 07:02:51.745389 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:51.745965 18714 external_mini_cluster.cc:1428] Setting key 9d4e969c6ac44970d7d2b7c588bc3ee0
I20260812 07:02:51.754207 25669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21: Bootstrap starting.
I20260812 07:02:51.757772 25669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:51.759040 25669 log.cc:824] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21: Log is configured to *not* fsync() on all Append() calls
Aug 12 07:02:51 dist-test-slave-tc2s krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 07:02:51.762084 25669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21: No bootstrap required, opened a new log
I20260812 07:02:51.768630 25674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:51.747776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:51755 (local address 127.0.0.1:43121)
0812 07:02:51.748503 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:51.748513 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:51.748553 (+ 40us) server_negotiation.cc:407] Connection header received
0812 07:02:51.750210 (+ 1657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:51.750232 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:51.750594 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:51.750889 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:51.752673 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:51.754003 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:51.755718 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:51.756368 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:51.756504 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:51.761516 (+ 5012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:51.761523 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:51.761536 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:51.761568 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:51.764542 (+ 2974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:51.765457 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:51.765463 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:51.765468 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:51.765632 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:51.766104 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:51.766108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:51.766110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:51.766645 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:51.766883 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:51.767360 (+ 477us) server_negotiation.cc:299] Negotiation successful
0812 07:02:51.767657 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":340,"threads_started":1}
I20260812 07:02:51.770717 25669 raft_consensus.cc:348] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13a6fa2b2824fa6aecd4a1a419e7e21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43121 } }
I20260812 07:02:51.771140 25669 raft_consensus.cc:374] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:51.771235 25669 raft_consensus.cc:729] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13a6fa2b2824fa6aecd4a1a419e7e21, State: Initialized, Role: FOLLOWER
I20260812 07:02:51.771823 25669 consensus_queue.cc:260] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13a6fa2b2824fa6aecd4a1a419e7e21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43121 } }
I20260812 07:02:51.772045 25669 raft_consensus.cc:388] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:51.772179 25669 raft_consensus.cc:482] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:51.772331 25669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:51.772357 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:02:51.774379 25669 raft_consensus.cc:504] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13a6fa2b2824fa6aecd4a1a419e7e21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43121 } }
I20260812 07:02:51.774931 25669 leader_election.cc:302] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f13a6fa2b2824fa6aecd4a1a419e7e21; no voters:
I20260812 07:02:51.775519 25669 leader_election.cc:288] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:51.775652 25682 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:51.777639 25682 raft_consensus.cc:686] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [term 1 LEADER]: Becoming Leader. State: Replica: f13a6fa2b2824fa6aecd4a1a419e7e21, State: Running, Role: LEADER
I20260812 07:02:51.777714 25669 sys_catalog.cc:564] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:51.778245 25682 consensus_queue.cc:237] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13a6fa2b2824fa6aecd4a1a419e7e21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43121 } }
I20260812 07:02:51.781800 25686 sys_catalog.cc:455] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f13a6fa2b2824fa6aecd4a1a419e7e21. Latest consensus state: current_term: 1 leader_uuid: "f13a6fa2b2824fa6aecd4a1a419e7e21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13a6fa2b2824fa6aecd4a1a419e7e21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43121 } } }
I20260812 07:02:51.782263 25686 sys_catalog.cc:458] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:51.781790 25684 sys_catalog.cc:455] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f13a6fa2b2824fa6aecd4a1a419e7e21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f13a6fa2b2824fa6aecd4a1a419e7e21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43121 } } }
I20260812 07:02:51.782737 25684 sys_catalog.cc:458] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21 [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:51.791602 25699 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:51.794888 25674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:51.776922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:55163 (local address 127.0.0.1:43121)
0812 07:02:51.777081 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:51.777087 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:51.777733 (+ 646us) server_negotiation.cc:407] Connection header received
0812 07:02:51.778038 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:51.778043 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:51.778116 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:51.778227 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:51.780004 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:51.781271 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:51.783379 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:51.784102 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:51.784864 (+ 762us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:51.787401 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:51.787409 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:51.787414 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:51.787464 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:51.791006 (+ 3542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:51.791991 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:51.791996 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:51.791999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:51.792146 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:51.792762 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:51.792767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:51.792771 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:51.793166 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:51.793434 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:51.794335 (+ 901us) server_negotiation.cc:299] Negotiation successful
0812 07:02:51.794522 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 07:02:51.796713 25699 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:51.804533 25699 catalog_manager.cc:1347] Generated new cluster ID: a759227296c54716bdbc7c8cc856cfae
I20260812 07:02:51.804628 25699 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:51.844497 25699 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:51.846097 25699 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:51.857474 25699 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f13a6fa2b2824fa6aecd4a1a419e7e21: Generated new TSK 0
I20260812 07:02:51.858458 25699 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:51.874686 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25540
I20260812 07:02:51.875839 25661 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:51.970448 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 25540
W20260812 07:02:51.995429 25513 connection.cc:535] client connection to 127.0.0.1:43121 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43121): Connection reset by peer (error 104)
2026-08-12T07:02:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2187 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:52 dist-test-slave-tc2s krb5kdc[25717](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:52 dist-test-slave-tc2s krb5kdc[25717](info): set up 2 sockets
Aug 12 07:02:52 dist-test-slave-tc2s krb5kdc[25717](info): commencing operation
krb5kdc: starting...
W20260812 07:02:53.223662 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:53 dist-test-slave-tc2s krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:02:53.488857 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42725
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:53.819980 25751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:53.820240 25751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:53.820358 25751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:53.827311 25751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:53.827419 25751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:53.827469 25751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:53.827529 25751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:53.827572 25751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:53.836949 25751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:53.838119 25751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:53.839349 25751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:53.850270 25762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:53.850350 25761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:53.850322 25765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:53.851197 25751 server_base.cc:1034] running on GCE node
I20260812 07:02:53.851926 25751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:53.853174 25751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:53.854367 25751 hybrid_clock.cc:648] HybridClock initialized: now 1786518173854328 us; error 27 us; skew 500 ppm
I20260812 07:02:53.854679 25751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:53 dist-test-slave-tc2s krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518173, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:53.857637 25751 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:02:53.859010 25751 webserver.cc:460] Webserver started at http://127.0.0.1:44529/ using document root <none> and password file <none>
I20260812 07:02:53.859609 25751 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:53.859723 25751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:53.860035 25751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:53.862921 25751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "9d93657838d247ebadcb5f851d89a21c"
format_stamp: "Formatted at 2026-08-12 07:02:53 on dist-test-slave-tc2s"
server_key: "356a0d756493b5a9b25ec81c4507a31a"
server_key_iv: "96228ba77b9b9d9f8a070b3e890675fc"
server_key_version: "encryptionkey@0"
I20260812 07:02:53.863641 25751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "9d93657838d247ebadcb5f851d89a21c"
format_stamp: "Formatted at 2026-08-12 07:02:53 on dist-test-slave-tc2s"
server_key: "356a0d756493b5a9b25ec81c4507a31a"
server_key_iv: "96228ba77b9b9d9f8a070b3e890675fc"
server_key_version: "encryptionkey@0"
I20260812 07:02:53.868345 25751 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 07:02:53.871539 25778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:53.872720 25751 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 07:02:53.872860 25751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "9d93657838d247ebadcb5f851d89a21c"
format_stamp: "Formatted at 2026-08-12 07:02:53 on dist-test-slave-tc2s"
server_key: "356a0d756493b5a9b25ec81c4507a31a"
server_key_iv: "96228ba77b9b9d9f8a070b3e890675fc"
server_key_version: "encryptionkey@0"
I20260812 07:02:53.873030 25751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:53.894040 25751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:53.897949 25751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:53.898195 25751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:53.914696 25751 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42725
I20260812 07:02:53.914737 25872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42725 every 8 connection(s)
I20260812 07:02:53.915901 25751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:53.919320 25873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:53.923007 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 25751
I20260812 07:02:53.923169 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:53.923599 18714 external_mini_cluster.cc:1428] Setting key 1f40275f4eb99f839874e2366f2d8930
I20260812 07:02:53.931380 25873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c: Bootstrap starting.
I20260812 07:02:53.934849 25873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:53.935837 25873 log.cc:824] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:53.938406 25873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c: No bootstrap required, opened a new log
I20260812 07:02:53.939131 25877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:53.926413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:42609 (local address 127.0.0.1:42725)
0812 07:02:53.927441 (+ 1028us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:53.927455 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:53.927944 (+ 489us) server_negotiation.cc:407] Connection header received
0812 07:02:53.930366 (+ 2422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:53.930393 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:53.930862 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:53.931265 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:53.931738 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:53.933689 (+ 1951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:53.935025 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:53.935688 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:53.935858 (+ 170us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:53.937020 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:53.937027 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:53.937040 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:53.937533 (+ 493us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:53.937605 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:53.937630 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:53.937773 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:53.938074 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 07:02:53.938212 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":464,"threads_started":1}
I20260812 07:02:53.942799 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:02:53.946125 25873 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d93657838d247ebadcb5f851d89a21c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42725 } }
I20260812 07:02:53.946470 25873 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:53.946556 25873 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d93657838d247ebadcb5f851d89a21c, State: Initialized, Role: FOLLOWER
I20260812 07:02:53.947161 25873 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d93657838d247ebadcb5f851d89a21c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42725 } }
I20260812 07:02:53.947415 25873 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:53.947564 25873 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:53.947731 25873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:53.950574 25873 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d93657838d247ebadcb5f851d89a21c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42725 } }
I20260812 07:02:53.951084 25873 leader_election.cc:302] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d93657838d247ebadcb5f851d89a21c; no voters:
I20260812 07:02:53.951692 25873 leader_election.cc:288] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:53.951783 25894 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:53.952477 25894 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [term 1 LEADER]: Becoming Leader. State: Replica: 9d93657838d247ebadcb5f851d89a21c, State: Running, Role: LEADER
I20260812 07:02:53.953399 25877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:53.946895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:41311 (local address 127.0.0.1:42725)
0812 07:02:53.947132 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:53.947138 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:53.947383 (+ 245us) server_negotiation.cc:407] Connection header received
0812 07:02:53.947574 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:53.947578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:53.947635 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:53.947731 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:53.948314 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:53.949069 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:53.950831 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:53.951330 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:53.951429 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:53.952596 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:53.952603 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:53.952612 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:53.952633 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:53.952701 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:53.952723 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:53.952832 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:53.953038 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 07:02:53.953089 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260812 07:02:53.953297 25894 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d93657838d247ebadcb5f851d89a21c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42725 } }
I20260812 07:02:53.954104 25873 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:53.956216 25896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d93657838d247ebadcb5f851d89a21c. Latest consensus state: current_term: 1 leader_uuid: "9d93657838d247ebadcb5f851d89a21c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d93657838d247ebadcb5f851d89a21c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42725 } } }
I20260812 07:02:53.956593 25896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:53.961798 25901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d93657838d247ebadcb5f851d89a21c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d93657838d247ebadcb5f851d89a21c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42725 } } }
I20260812 07:02:53.962289 25901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:53.962466 25909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:53.967669 25909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:53.976195 25909 catalog_manager.cc:1347] Generated new cluster ID: fe0d8934d0694c5990b0c27acf4a57ae
I20260812 07:02:53.976289 25909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:53.991030 25909 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:53.992695 25909 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:54.005983 25909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d93657838d247ebadcb5f851d89a21c: Generated new TSK 0
I20260812 07:02:54.006996 25909 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:54.023360 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25751
W20260812 07:02:54.024688 25865 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.137:42609
W20260812 07:02:54.025436 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25751: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:02:54.025563 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 25751
W20260812 07:02:54.050107 25712 connection.cc:535] client connection to 127.0.0.1:42725 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42725): Connection reset by peer (error 104)
2026-08-12T07:02:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2054 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:54 dist-test-slave-tc2s krb5kdc[25936](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:54 dist-test-slave-tc2s krb5kdc[25936](info): set up 2 sockets
Aug 12 07:02:54 dist-test-slave-tc2s krb5kdc[25936](info): commencing operation
krb5kdc: starting...
W20260812 07:02:55.288882 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.001s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:55 dist-test-slave-tc2s krb5kdc[25936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:02:55.582752 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33595
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:55.920691 25957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:55.920953 25957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:55.921090 25957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:55.928090 25957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:55.928189 25957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:55.928246 25957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:55.928332 25957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:55.928390 25957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:55.938935 25957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:55.940198 25957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:55.941452 25957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:55.952661 25966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:55.952745 25967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:55.952699 25969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:55.953693 25957 server_base.cc:1034] running on GCE node
I20260812 07:02:55.954484 25957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:55.955786 25957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:55.957000 25957 hybrid_clock.cc:648] HybridClock initialized: now 1786518175956964 us; error 30 us; skew 500 ppm
I20260812 07:02:55.957397 25957 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:55 dist-test-slave-tc2s krb5kdc[25936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518175, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:55.963949 25957 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:02:55.965411 25957 webserver.cc:460] Webserver started at http://127.0.0.1:33789/ using document root <none> and password file <none>
I20260812 07:02:55.966122 25957 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:55.966253 25957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:55.966607 25957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:55.969633 25957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "aae276172bf94152be903033a25b749f"
format_stamp: "Formatted at 2026-08-12 07:02:55 on dist-test-slave-tc2s"
server_key: "d8208716313a76d7e2c69db054214c6c"
server_key_iv: "52f8624fd1d78a0205428e54ebc8770b"
server_key_version: "encryptionkey@0"
I20260812 07:02:55.970427 25957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "aae276172bf94152be903033a25b749f"
format_stamp: "Formatted at 2026-08-12 07:02:55 on dist-test-slave-tc2s"
server_key: "d8208716313a76d7e2c69db054214c6c"
server_key_iv: "52f8624fd1d78a0205428e54ebc8770b"
server_key_version: "encryptionkey@0"
I20260812 07:02:55.975296 25957 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 07:02:55.978600 25984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:55.979792 25957 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 07:02:55.979947 25957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "aae276172bf94152be903033a25b749f"
format_stamp: "Formatted at 2026-08-12 07:02:55 on dist-test-slave-tc2s"
server_key: "d8208716313a76d7e2c69db054214c6c"
server_key_iv: "52f8624fd1d78a0205428e54ebc8770b"
server_key_version: "encryptionkey@0"
I20260812 07:02:55.980134 25957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:55.985625 25957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:55.989461 25957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:55.989727 25957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:56.007125 25957 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33595
I20260812 07:02:56.007164 26075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33595 every 8 connection(s)
I20260812 07:02:56.008455 25957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:56.010979 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 25957
I20260812 07:02:56.011166 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:56.011713 18714 external_mini_cluster.cc:1428] Setting key f20aad3c1b105cfdc8ecb79a7e0b6646
I20260812 07:02:56.013021 26076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:56.019191 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:56.013519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:36939 (local address 127.0.0.1:33595)
0812 07:02:56.014288 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:56.014300 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:56.014340 (+ 40us) server_negotiation.cc:407] Connection header received
0812 07:02:56.015907 (+ 1567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:56.015929 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:56.016268 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:56.016593 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:56.017646 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:56.017655 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:56.017668 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:56.017682 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:56.017764 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:56.017787 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:56.017996 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:56.018097 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 07:02:56.018277 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":352,"threads_started":1}
I20260812 07:02:56.022787 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:02:56.026351 26076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f: Bootstrap starting.
I20260812 07:02:56.030330 26076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:56.030607 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:56.028200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:37437 (local address 127.0.0.1:33595)
0812 07:02:56.028406 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:56.028411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:56.028709 (+ 298us) server_negotiation.cc:407] Connection header received
0812 07:02:56.028872 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:56.028876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:56.028926 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:56.029005 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:56.029951 (+ 946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:56.029956 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:56.029959 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:02:56.029975 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:56.030013 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:02:56.030028 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:56.030115 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:56.030270 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 07:02:56.030321 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 07:02:56.031559 26076 log.cc:824] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:56.034494 26076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f: No bootstrap required, opened a new log
I20260812 07:02:56.041864 26076 raft_consensus.cc:348] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae276172bf94152be903033a25b749f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33595 } }
I20260812 07:02:56.042269 26076 raft_consensus.cc:374] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:56.042366 26076 raft_consensus.cc:729] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae276172bf94152be903033a25b749f, State: Initialized, Role: FOLLOWER
I20260812 07:02:56.042915 26076 consensus_queue.cc:260] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae276172bf94152be903033a25b749f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33595 } }
I20260812 07:02:56.043115 26076 raft_consensus.cc:388] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:56.043241 26076 raft_consensus.cc:482] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:56.043393 26076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:56.045595 26076 raft_consensus.cc:504] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae276172bf94152be903033a25b749f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33595 } }
I20260812 07:02:56.046116 26076 leader_election.cc:302] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aae276172bf94152be903033a25b749f; no voters:
I20260812 07:02:56.046649 26076 leader_election.cc:288] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:56.046769 26092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:56.047420 26092 raft_consensus.cc:686] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [term 1 LEADER]: Becoming Leader. State: Replica: aae276172bf94152be903033a25b749f, State: Running, Role: LEADER
I20260812 07:02:56.047945 26092 consensus_queue.cc:237] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae276172bf94152be903033a25b749f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33595 } }
I20260812 07:02:56.048622 26076 sys_catalog.cc:564] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:56.051239 26093 sys_catalog.cc:455] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aae276172bf94152be903033a25b749f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae276172bf94152be903033a25b749f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33595 } } }
I20260812 07:02:56.051196 26094 sys_catalog.cc:455] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [sys.catalog]: SysCatalogTable state changed. Reason: New leader aae276172bf94152be903033a25b749f. Latest consensus state: current_term: 1 leader_uuid: "aae276172bf94152be903033a25b749f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae276172bf94152be903033a25b749f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33595 } } }
I20260812 07:02:56.051798 26093 sys_catalog.cc:458] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:56.053996 26094 sys_catalog.cc:458] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:56.054553 26100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:56.059168 26100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:56.067657 26100 catalog_manager.cc:1347] Generated new cluster ID: c8826fedfe1e4c4eab2263ccea0ba333
I20260812 07:02:56.067764 26100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:56.084097 26100 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:56.084555 26100 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:56.092329 26100 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aae276172bf94152be903033a25b749f: Generated new TSK 0
I20260812 07:02:56.093041 26100 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:56.099028 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25957
W20260812 07:02:56.100116 26071 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.137:36939
W20260812 07:02:56.100917 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 25957: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:02:56.101074 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 25957
2026-08-12T07:02:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2078 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:56 dist-test-slave-tc2s krb5kdc[26127](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:56 dist-test-slave-tc2s krb5kdc[26127](info): set up 2 sockets
Aug 12 07:02:56 dist-test-slave-tc2s krb5kdc[26127](info): commencing operation
krb5kdc: starting...
W20260812 07:02:57.381449 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.004s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:57 dist-test-slave-tc2s krb5kdc[26127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:02:57.658471 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38749
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:02:57.990164 26157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:02:57.990449 26157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:02:57.990583 26157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:02:57.997571 26157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:02:57.997668 26157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:02:57.997718 26157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:02:57.997779 26157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:02:57.997821 26157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:02:58.007282 26157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38749
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:02:58.008533 26157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:02:58.009788 26157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:02:58.020951 26170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:58.020917 26171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:02:58.021003 26179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:02:58.022167 26157 server_base.cc:1034] running on GCE node
I20260812 07:02:58.022909 26157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:02:58.024252 26157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:02:58.025455 26157 hybrid_clock.cc:648] HybridClock initialized: now 1786518178025410 us; error 33 us; skew 500 ppm
I20260812 07:02:58.025784 26157 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:02:58 dist-test-slave-tc2s krb5kdc[26127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518178, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:02:58.028756 26157 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:02:58.030217 26157 webserver.cc:460] Webserver started at http://127.0.0.1:38011/ using document root <none> and password file <none>
I20260812 07:02:58.030845 26157 fs_manager.cc:359] Metadata directory not provided
I20260812 07:02:58.030963 26157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:02:58.031242 26157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:02:58.034154 26157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "4875b8ff7c8148bf8c02c9991da6b926"
format_stamp: "Formatted at 2026-08-12 07:02:58 on dist-test-slave-tc2s"
server_key: "1100bbd264b86a40a7207396830d23b0"
server_key_iv: "3487060cde730aa9fced581553c0e672"
server_key_version: "encryptionkey@0"
I20260812 07:02:58.034891 26157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "4875b8ff7c8148bf8c02c9991da6b926"
format_stamp: "Formatted at 2026-08-12 07:02:58 on dist-test-slave-tc2s"
server_key: "1100bbd264b86a40a7207396830d23b0"
server_key_iv: "3487060cde730aa9fced581553c0e672"
server_key_version: "encryptionkey@0"
I20260812 07:02:58.039655 26157 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 07:02:58.042910 26200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:02:58.044100 26157 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:02:58.044265 26157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "4875b8ff7c8148bf8c02c9991da6b926"
format_stamp: "Formatted at 2026-08-12 07:02:58 on dist-test-slave-tc2s"
server_key: "1100bbd264b86a40a7207396830d23b0"
server_key_iv: "3487060cde730aa9fced581553c0e672"
server_key_version: "encryptionkey@0"
I20260812 07:02:58.044448 26157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:02:58.077279 26157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:02:58.081252 26157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:02:58.081526 26157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:02:58.099136 26157 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38749
I20260812 07:02:58.099159 26291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38749 every 8 connection(s)
I20260812 07:02:58.100440 26157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:02:58.103895 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 26157
I20260812 07:02:58.104022 26292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:02:58.104056 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:02:58.104477 18714 external_mini_cluster.cc:1428] Setting key 3b2a91f84e92406a8d0a59bca927099a
I20260812 07:02:58.118039 26292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926: Bootstrap starting.
Aug 12 07:02:58 dist-test-slave-tc2s krb5kdc[26127](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 07:02:58.121649 26292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926: Neither blocks nor log segments found. Creating new log.
I20260812 07:02:58.123034 26292 log.cc:824] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926: Log is configured to *not* fsync() on all Append() calls
I20260812 07:02:58.126361 26292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926: No bootstrap required, opened a new log
I20260812 07:02:58.128474 26296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:58.106223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:38167 (local address 127.0.0.1:38749)
0812 07:02:58.107028 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:58.107042 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:58.107090 (+ 48us) server_negotiation.cc:407] Connection header received
0812 07:02:58.108872 (+ 1782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:58.108898 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:58.109396 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:58.109805 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:58.111182 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:58.113134 (+ 1952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:58.114497 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:58.115548 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:58.115732 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:58.119955 (+ 4223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:58.119966 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:58.119986 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:58.120037 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:58.123947 (+ 3910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:58.124854 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:58.124863 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:58.124870 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:58.125076 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:58.125477 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:58.125482 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:58.125485 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:58.126153 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:58.126492 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:58.126839 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 07:02:58.127172 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":321,"threads_started":1}
I20260812 07:02:58.132191 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:02:58.134660 26292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4875b8ff7c8148bf8c02c9991da6b926" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38749 } }
I20260812 07:02:58.135039 26292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:02:58.135151 26292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4875b8ff7c8148bf8c02c9991da6b926, State: Initialized, Role: FOLLOWER
I20260812 07:02:58.135707 26292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4875b8ff7c8148bf8c02c9991da6b926" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38749 } }
I20260812 07:02:58.135941 26292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:02:58.136072 26292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:02:58.136268 26292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:02:58.138620 26292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4875b8ff7c8148bf8c02c9991da6b926" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38749 } }
I20260812 07:02:58.139169 26292 leader_election.cc:302] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4875b8ff7c8148bf8c02c9991da6b926; no voters:
I20260812 07:02:58.139751 26292 leader_election.cc:288] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:02:58.139853 26307 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:02:58.142144 26292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:02:58.146200 26307 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [term 1 LEADER]: Becoming Leader. State: Replica: 4875b8ff7c8148bf8c02c9991da6b926, State: Running, Role: LEADER
I20260812 07:02:58.146920 26307 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4875b8ff7c8148bf8c02c9991da6b926" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38749 } }
I20260812 07:02:58.150310 26309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4875b8ff7c8148bf8c02c9991da6b926" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4875b8ff7c8148bf8c02c9991da6b926" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38749 } } }
I20260812 07:02:58.150741 26309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:58.151254 26317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4875b8ff7c8148bf8c02c9991da6b926. Latest consensus state: current_term: 1 leader_uuid: "4875b8ff7c8148bf8c02c9991da6b926" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4875b8ff7c8148bf8c02c9991da6b926" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38749 } } }
I20260812 07:02:58.151574 26317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926 [sys.catalog]: This master's current role is: LEADER
I20260812 07:02:58.154240 26296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:02:58.136456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:52777 (local address 127.0.0.1:38749)
0812 07:02:58.136676 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 07:02:58.136683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:02:58.138547 (+ 1864us) server_negotiation.cc:407] Connection header received
0812 07:02:58.138682 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:02:58.138687 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:02:58.138767 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:02:58.138870 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:02:58.140594 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:58.141467 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:58.142945 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:02:58.143390 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:02:58.143525 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:02:58.146394 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:02:58.146404 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:02:58.146409 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:02:58.146451 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:02:58.149827 (+ 3376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:58.151071 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:58.151077 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:58.151080 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:58.151223 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:02:58.152025 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:02:58.152034 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:02:58.152038 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:02:58.152516 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:02:58.152807 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0812 07:02:58.153587 (+ 780us) server_negotiation.cc:299] Negotiation successful
0812 07:02:58.153799 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 07:02:58.161175 26325 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:02:58.166842 26325 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:02:58.176283 26325 catalog_manager.cc:1347] Generated new cluster ID: 0efca04ae8984cd5b998e8f57e53192f
I20260812 07:02:58.176414 26325 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:02:58.194418 26325 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:02:58.195711 26325 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:02:58.203344 26325 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4875b8ff7c8148bf8c02c9991da6b926: Generated new TSK 0
I20260812 07:02:58.204409 26325 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:02:58.217280 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 26157
I20260812 07:02:58.218768 26286 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:02:58.310597 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 26157
W20260812 07:02:58.335337 26123 connection.cc:535] client connection to 127.0.0.1:38749 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38749): Connection reset by peer (error 104)
2026-08-12T07:02:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2211 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:02:58 dist-test-slave-tc2s krb5kdc[26360](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:02:58 dist-test-slave-tc2s krb5kdc[26360](info): set up 2 sockets
Aug 12 07:02:58 dist-test-slave-tc2s krb5kdc[26360](info): commencing operation
krb5kdc: starting...
W20260812 07:02:59.586935 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:02:59 dist-test-slave-tc2s krb5kdc[26360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:02:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:02:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:02:59.870556 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46137
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:03:00.220937 26382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:00.221220 26382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:00.221356 26382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:00.228440 26382 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:00.228542 26382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:00.228616 26382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:00.228698 26382 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:00.228756 26382 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:00.238278 26382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46137
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:00.239478 26382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:00.240756 26382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:00.251816 26389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:00.251793 26397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:00.251803 26391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:00.252580 26382 server_base.cc:1034] running on GCE node
I20260812 07:03:00.253351 26382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:00.254705 26382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:00.255901 26382 hybrid_clock.cc:648] HybridClock initialized: now 1786518180255850 us; error 40 us; skew 500 ppm
I20260812 07:03:00.256232 26382 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:00 dist-test-slave-tc2s krb5kdc[26360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518180, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:00.259189 26382 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:03:00.260550 26382 webserver.cc:460] Webserver started at http://127.0.0.1:45647/ using document root <none> and password file <none>
I20260812 07:03:00.261197 26382 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:00.261314 26382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:00.261596 26382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:00.264492 26382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "a777c3aafe144f0682a24c8bcb1a7dfe"
format_stamp: "Formatted at 2026-08-12 07:03:00 on dist-test-slave-tc2s"
server_key: "97af4688d36f58cf0af4df08ca7bca55"
server_key_iv: "ab9e1a4635f8c26ebc40b87872b91b2f"
server_key_version: "encryptionkey@0"
I20260812 07:03:00.265244 26382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "a777c3aafe144f0682a24c8bcb1a7dfe"
format_stamp: "Formatted at 2026-08-12 07:03:00 on dist-test-slave-tc2s"
server_key: "97af4688d36f58cf0af4df08ca7bca55"
server_key_iv: "ab9e1a4635f8c26ebc40b87872b91b2f"
server_key_version: "encryptionkey@0"
I20260812 07:03:00.270432 26382 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260812 07:03:00.273646 26412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:00.274861 26382 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 07:03:00.275029 26382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "a777c3aafe144f0682a24c8bcb1a7dfe"
format_stamp: "Formatted at 2026-08-12 07:03:00 on dist-test-slave-tc2s"
server_key: "97af4688d36f58cf0af4df08ca7bca55"
server_key_iv: "ab9e1a4635f8c26ebc40b87872b91b2f"
server_key_version: "encryptionkey@0"
I20260812 07:03:00.275205 26382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:00.292003 26382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:00.295737 26382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:00.295993 26382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:00.312556 26382 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46137
I20260812 07:03:00.312614 26508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46137 every 8 connection(s)
I20260812 07:03:00.313804 26382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:03:00.316164 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 26382
I20260812 07:03:00.316342 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:03:00.316793 18714 external_mini_cluster.cc:1428] Setting key bd856ca2f94572e520def522e051e07f
I20260812 07:03:00.317552 26509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:00.330562 26513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:00.318496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:58731 (local address 127.0.0.1:46137)
0812 07:03:00.319292 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:00.319305 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:00.319353 (+ 48us) server_negotiation.cc:407] Connection header received
0812 07:03:00.321030 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:00.321055 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:00.321531 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:00.321973 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:00.322458 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:00.324442 (+ 1984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:00.325681 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:00.326694 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:00.326874 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:00.328009 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:00.328019 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:00.328039 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:00.328724 (+ 685us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:00.328821 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:00.328860 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:00.329023 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:00.329176 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 07:03:00.329336 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":332,"threads_started":1}
I20260812 07:03:00.332077 26509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe: Bootstrap starting.
I20260812 07:03:00.334280 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:03:00.335387 26509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:00.336287 26509 log.cc:824] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:00.338982 26509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe: No bootstrap required, opened a new log
I20260812 07:03:00.344612 26513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:00.338480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:57969 (local address 127.0.0.1:46137)
0812 07:03:00.338634 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:00.338640 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:00.338929 (+ 289us) server_negotiation.cc:407] Connection header received
0812 07:03:00.339073 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:00.339078 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:00.339146 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:00.339244 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:00.339706 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:00.340825 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:00.342152 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:00.342828 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:00.342966 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:00.343905 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:00.343911 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:00.343917 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:00.343936 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:00.343982 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:00.344001 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:00.344113 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:00.344237 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 07:03:00.344289 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 07:03:00.347664 26509 raft_consensus.cc:348] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a777c3aafe144f0682a24c8bcb1a7dfe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } }
I20260812 07:03:00.348068 26509 raft_consensus.cc:374] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:03:00.348161 26509 raft_consensus.cc:729] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a777c3aafe144f0682a24c8bcb1a7dfe, State: Initialized, Role: FOLLOWER
I20260812 07:03:00.348704 26509 consensus_queue.cc:260] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a777c3aafe144f0682a24c8bcb1a7dfe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } }
I20260812 07:03:00.348912 26509 raft_consensus.cc:388] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:03:00.349040 26509 raft_consensus.cc:482] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:03:00.349185 26509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:00.351281 26509 raft_consensus.cc:504] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a777c3aafe144f0682a24c8bcb1a7dfe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } }
I20260812 07:03:00.351727 26509 leader_election.cc:302] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a777c3aafe144f0682a24c8bcb1a7dfe; no voters:
I20260812 07:03:00.352234 26509 leader_election.cc:288] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:03:00.352353 26524 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:03:00.353546 26524 raft_consensus.cc:686] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [term 1 LEADER]: Becoming Leader. State: Replica: a777c3aafe144f0682a24c8bcb1a7dfe, State: Running, Role: LEADER
I20260812 07:03:00.354097 26524 consensus_queue.cc:237] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a777c3aafe144f0682a24c8bcb1a7dfe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } }
I20260812 07:03:00.354252 26509 sys_catalog.cc:564] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:00.356554 26526 sys_catalog.cc:455] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [sys.catalog]: SysCatalogTable state changed. Reason: New leader a777c3aafe144f0682a24c8bcb1a7dfe. Latest consensus state: current_term: 1 leader_uuid: "a777c3aafe144f0682a24c8bcb1a7dfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a777c3aafe144f0682a24c8bcb1a7dfe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } } }
I20260812 07:03:00.356909 26526 sys_catalog.cc:458] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:00.357370 26525 sys_catalog.cc:455] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a777c3aafe144f0682a24c8bcb1a7dfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a777c3aafe144f0682a24c8bcb1a7dfe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } } }
I20260812 07:03:00.357685 26525 sys_catalog.cc:458] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:00.357810 26535 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:03:00.363341 26535 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:03:00.371824 26535 catalog_manager.cc:1347] Generated new cluster ID: 493352b1fc2b46098760e3bebcb7f011
I20260812 07:03:00.371927 26535 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:03:00.388700 26535 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:03:00.389868 26535 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:03:00.397791 26535 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a777c3aafe144f0682a24c8bcb1a7dfe: Generated new TSK 0
I20260812 07:03:00.398490 26535 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:03:00.404086 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 26382
W20260812 07:03:00.405099 26503 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.137:58731
W20260812 07:03:00.405777 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 26382: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:03:00.405920 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 26382
W20260812 07:03:00.433312 26352 connection.cc:535] client connection to 127.0.0.1:46137 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46137): Connection reset by peer (error 104)
2026-08-12T07:03:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2093 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:03:00 dist-test-slave-tc2s krb5kdc[26555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:03:00 dist-test-slave-tc2s krb5kdc[26555](info): set up 2 sockets
Aug 12 07:03:00 dist-test-slave-tc2s krb5kdc[26555](info): commencing operation
krb5kdc: starting...
W20260812 07:03:01.685454 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:03:01 dist-test-slave-tc2s krb5kdc[26555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:03:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:03:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 07:03:01.958477 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45321
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:03:02.286762 26578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:02.287083 26578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:02.287228 26578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:02.295313 26578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:02.295439 26578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:02.295519 26578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:02.295603 26578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:02.295663 26578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:02.305794 26578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45321
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:02.307142 26578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:02.308702 26578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:02.322001 26595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:02.322078 26592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:02.322052 26593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:02.322717 26578 server_base.cc:1034] running on GCE node
I20260812 07:03:02.323504 26578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:02.324818 26578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:02.325984 26578 hybrid_clock.cc:648] HybridClock initialized: now 1786518182325951 us; error 27 us; skew 500 ppm
I20260812 07:03:02.326315 26578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:02 dist-test-slave-tc2s krb5kdc[26555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518182, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:02.332162 26578 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 07:03:02.333619 26578 webserver.cc:460] Webserver started at http://127.0.0.1:43993/ using document root <none> and password file <none>
I20260812 07:03:02.334337 26578 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:02.334457 26578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:02.334755 26578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:02.337702 26578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "6f2ae38710a94b84b96df00a2b32990f"
format_stamp: "Formatted at 2026-08-12 07:03:02 on dist-test-slave-tc2s"
server_key: "f2f949410bf9377e79844c9289ea34f2"
server_key_iv: "c26a1ddc7aa4a0177649b158f6e824c0"
server_key_version: "encryptionkey@0"
I20260812 07:03:02.338486 26578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "6f2ae38710a94b84b96df00a2b32990f"
format_stamp: "Formatted at 2026-08-12 07:03:02 on dist-test-slave-tc2s"
server_key: "f2f949410bf9377e79844c9289ea34f2"
server_key_iv: "c26a1ddc7aa4a0177649b158f6e824c0"
server_key_version: "encryptionkey@0"
I20260812 07:03:02.344027 26578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 07:03:02.347573 26617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:02.348795 26578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 07:03:02.348958 26578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "6f2ae38710a94b84b96df00a2b32990f"
format_stamp: "Formatted at 2026-08-12 07:03:02 on dist-test-slave-tc2s"
server_key: "f2f949410bf9377e79844c9289ea34f2"
server_key_iv: "c26a1ddc7aa4a0177649b158f6e824c0"
server_key_version: "encryptionkey@0"
I20260812 07:03:02.349143 26578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:02.354890 26578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:02.358964 26578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:02.359256 26578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:02.377259 26578 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45321
I20260812 07:03:02.377297 26715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45321 every 8 connection(s)
I20260812 07:03:02.378657 26578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:03:02.382309 26718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:02.382573 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 26578
I20260812 07:03:02.382769 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:03:02.383322 18714 external_mini_cluster.cc:1428] Setting key d8d3636b21d31d5453ae66b8a3c01ed8
I20260812 07:03:02.391718 26721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:02.385095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:40143 (local address 127.0.0.1:45321)
0812 07:03:02.385976 (+ 881us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:02.385988 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:02.386031 (+ 43us) server_negotiation.cc:407] Connection header received
0812 07:03:02.388572 (+ 2541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:02.388595 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:02.388936 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:02.389245 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:02.390277 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:02.390283 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:02.390296 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:02.390309 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:02.390389 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:02.390413 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:02.390576 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:02.390674 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 07:03:02.390845 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":373,"threads_started":1}
I20260812 07:03:02.395153 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:03:02.395197 26718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f: Bootstrap starting.
I20260812 07:03:02.398866 26718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:02.400146 26718 log.cc:824] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:02.402828 26721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:02.400489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.137:39137 (local address 127.0.0.1:45321)
0812 07:03:02.400668 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:02.400675 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:02.401055 (+ 380us) server_negotiation.cc:407] Connection header received
0812 07:03:02.401162 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:02.401166 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:02.401228 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:02.401339 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:02.402220 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:02.402225 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:02.402228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:02.402243 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:02.402282 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:02.402297 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:02.402411 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:02.402512 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 07:03:02.402559 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 07:03:02.403427 26718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f: No bootstrap required, opened a new log
I20260812 07:03:02.410389 26718 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2ae38710a94b84b96df00a2b32990f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260812 07:03:02.410738 26718 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:03:02.410832 26718 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2ae38710a94b84b96df00a2b32990f, State: Initialized, Role: FOLLOWER
I20260812 07:03:02.411361 26718 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2ae38710a94b84b96df00a2b32990f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260812 07:03:02.411583 26718 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:03:02.411715 26718 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:03:02.411860 26718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:02.414275 26718 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2ae38710a94b84b96df00a2b32990f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260812 07:03:02.414742 26718 leader_election.cc:302] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f2ae38710a94b84b96df00a2b32990f; no voters:
I20260812 07:03:02.415294 26718 leader_election.cc:288] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:03:02.415419 26738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:03:02.416642 26738 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [term 1 LEADER]: Becoming Leader. State: Replica: 6f2ae38710a94b84b96df00a2b32990f, State: Running, Role: LEADER
I20260812 07:03:02.417227 26738 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2ae38710a94b84b96df00a2b32990f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } }
I20260812 07:03:02.417625 26718 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:02.420015 26740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f2ae38710a94b84b96df00a2b32990f. Latest consensus state: current_term: 1 leader_uuid: "6f2ae38710a94b84b96df00a2b32990f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2ae38710a94b84b96df00a2b32990f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } } }
I20260812 07:03:02.420267 26739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f2ae38710a94b84b96df00a2b32990f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2ae38710a94b84b96df00a2b32990f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45321 } } }
I20260812 07:03:02.420581 26740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:02.420650 26739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:02.424204 26750 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:03:02.428534 26750 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:03:02.436231 26750 catalog_manager.cc:1347] Generated new cluster ID: cde4c4d82add41f2b2acd601e7b42557
I20260812 07:03:02.436337 26750 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:03:02.448637 26750 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:03:02.449102 26750 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:03:02.461062 26750 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f2ae38710a94b84b96df00a2b32990f: Generated new TSK 0
I20260812 07:03:02.461961 26750 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:03:02.469712 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 26578
W20260812 07:03:02.471239 26708 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.137:40143
W20260812 07:03:02.471963 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 26578: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:03:02.472103 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 26578
2026-08-12T07:03:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2063 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:03:02 dist-test-slave-tc2s krb5kdc[26771](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:03:02 dist-test-slave-tc2s krb5kdc[26771](info): set up 2 sockets
Aug 12 07:03:02 dist-test-slave-tc2s krb5kdc[26771](info): commencing operation
krb5kdc: starting...
W20260812 07:03:03.739375 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:03:03 dist-test-slave-tc2s krb5kdc[26771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518183, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:03:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:03:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:03:04.004300 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41905
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:44879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:41905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:03:04.329546 26794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:04.329828 26794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:04.330008 26794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:04.336835 26794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:04.336944 26794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:04.337026 26794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:04.337108 26794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:04.337169 26794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:04.346423 26794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:44879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:41905
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:41905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:04.347525 26794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:04.348681 26794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:04.359632 26804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:04.359669 26805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:04.359767 26809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:04.360361 26794 server_base.cc:1034] running on GCE node
I20260812 07:03:04.361011 26794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:04.362303 26794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:04.363489 26794 hybrid_clock.cc:648] HybridClock initialized: now 1786518184363440 us; error 44 us; skew 500 ppm
I20260812 07:03:04.363782 26794 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:04 dist-test-slave-tc2s krb5kdc[26771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518184, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:04.366735 26794 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:03:04.368014 26794 webserver.cc:460] Webserver started at http://127.18.70.190:42415/ using document root <none> and password file <none>
I20260812 07:03:04.368602 26794 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:04.368698 26794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:04.368932 26794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:04.371680 26794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "0431a7dac5b34d2aa2a4ed45d58a15c6"
format_stamp: "Formatted at 2026-08-12 07:03:04 on dist-test-slave-tc2s"
server_key: "3956c56ed188f217d65671d8ac8a77c6"
server_key_iv: "e2f8938fa32fd619fe9a7f5f82efe902"
server_key_version: "encryptionkey@0"
I20260812 07:03:04.372339 26794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "0431a7dac5b34d2aa2a4ed45d58a15c6"
format_stamp: "Formatted at 2026-08-12 07:03:04 on dist-test-slave-tc2s"
server_key: "3956c56ed188f217d65671d8ac8a77c6"
server_key_iv: "e2f8938fa32fd619fe9a7f5f82efe902"
server_key_version: "encryptionkey@0"
I20260812 07:03:04.376995 26794 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 07:03:04.380182 26827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:04.381350 26794 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 07:03:04.381495 26794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "0431a7dac5b34d2aa2a4ed45d58a15c6"
format_stamp: "Formatted at 2026-08-12 07:03:04 on dist-test-slave-tc2s"
server_key: "3956c56ed188f217d65671d8ac8a77c6"
server_key_iv: "e2f8938fa32fd619fe9a7f5f82efe902"
server_key_version: "encryptionkey@0"
I20260812 07:03:04.381657 26794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:04.401831 26794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:04.405701 26794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:04.405970 26794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:04.423184 26794 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:41905
I20260812 07:03:04.423213 26925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:41905 every 8 connection(s)
I20260812 07:03:04.424425 26794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:03:04.427384 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 26794
I20260812 07:03:04.427585 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:03:04.428151 18714 external_mini_cluster.cc:1428] Setting key 137cef44fba2d83dfc7c5bf286a05dec
I20260812 07:03:04.428174 26926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:04.441776 26926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6: Bootstrap starting.
Aug 12 07:03:04 dist-test-slave-tc2s krb5kdc[26771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518183, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:03:04.444772 26926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:04.445772 26926 log.cc:824] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:04.448231 26926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6: No bootstrap required, opened a new log
I20260812 07:03:04.450412 26938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:04.429980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39553 (local address 127.18.70.190:41905)
0812 07:03:04.430829 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:04.430840 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:04.430883 (+ 43us) server_negotiation.cc:407] Connection header received
0812 07:03:04.432653 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:04.432674 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:04.433027 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:04.433331 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:04.435124 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:04.436395 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:04.438100 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:04.438777 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:04.438912 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:04.443505 (+ 4593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:04.443512 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:04.443524 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:04.443561 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:04.446499 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:04.447270 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:04.447276 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:04.447281 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:04.447449 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:04.447885 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:04.447888 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:04.447890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:04.448379 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:04.448710 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:04.449176 (+ 466us) server_negotiation.cc:299] Negotiation successful
0812 07:03:04.449452 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":385,"threads_started":1}
I20260812 07:03:04.453955 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:03:04.455981 26926 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0431a7dac5b34d2aa2a4ed45d58a15c6" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41905 } }
I20260812 07:03:04.456364 26926 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:03:04.456476 26926 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0431a7dac5b34d2aa2a4ed45d58a15c6, State: Initialized, Role: FOLLOWER
I20260812 07:03:04.457122 26926 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0431a7dac5b34d2aa2a4ed45d58a15c6" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41905 } }
I20260812 07:03:04.457376 26926 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:03:04.457501 26926 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:03:04.457659 26926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:04.460052 26926 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0431a7dac5b34d2aa2a4ed45d58a15c6" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41905 } }
I20260812 07:03:04.460623 26926 leader_election.cc:302] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0431a7dac5b34d2aa2a4ed45d58a15c6; no voters:
I20260812 07:03:04.461246 26926 leader_election.cc:288] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:03:04.461338 26949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:03:04.463071 26926 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:04.463426 26949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [term 1 LEADER]: Becoming Leader. State: Replica: 0431a7dac5b34d2aa2a4ed45d58a15c6, State: Running, Role: LEADER
I20260812 07:03:04.463961 26949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0431a7dac5b34d2aa2a4ed45d58a15c6" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41905 } }
I20260812 07:03:04.466809 26952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0431a7dac5b34d2aa2a4ed45d58a15c6. Latest consensus state: current_term: 1 leader_uuid: "0431a7dac5b34d2aa2a4ed45d58a15c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0431a7dac5b34d2aa2a4ed45d58a15c6" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41905 } } }
I20260812 07:03:04.467669 26952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:04.467379 26951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0431a7dac5b34d2aa2a4ed45d58a15c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0431a7dac5b34d2aa2a4ed45d58a15c6" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 41905 } } }
I20260812 07:03:04.468895 26951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6 [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:04.470386 26960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:03:04.474009 26938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:04.458048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32817 (local address 127.18.70.190:41905)
0812 07:03:04.458209 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:04.458219 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:04.458589 (+ 370us) server_negotiation.cc:407] Connection header received
0812 07:03:04.458701 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:04.458709 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:04.458779 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:04.458894 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:04.460205 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:04.461337 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:04.463164 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:04.463818 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:04.463997 (+ 179us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:04.466955 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:04.466962 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:04.466966 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:04.467007 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:04.470598 (+ 3591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:04.471462 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:04.471466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:04.471468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:04.471589 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:04.472078 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:04.472082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:04.472086 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:04.472522 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:04.472814 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:04.473205 (+ 391us) server_negotiation.cc:299] Negotiation successful
0812 07:03:04.473380 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":47}
I20260812 07:03:04.477418 26960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:03:04.486452 26960 catalog_manager.cc:1347] Generated new cluster ID: fe89fb776dce4565b598181819c7b49a
I20260812 07:03:04.486557 26960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:03:04.494880 26960 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:03:04.496001 26960 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:03:04.508574 26960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0431a7dac5b34d2aa2a4ed45d58a15c6: Generated new TSK 0
I20260812 07:03:04.509315 26960 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:03:04.522362 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 26794
I20260812 07:03:04.523388 26916 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:03:04.613023 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 26794
W20260812 07:03:04.635475 26768 connection.cc:535] client connection to 127.18.70.190:41905 recv error: Network error: failed to read from TLS socket (remote: 127.18.70.190:41905): Connection reset by peer (error 104)
2026-08-12T07:03:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2138 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:03:04 dist-test-slave-tc2s krb5kdc[26985](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:03:04 dist-test-slave-tc2s krb5kdc[26985](info): set up 2 sockets
Aug 12 07:03:04 dist-test-slave-tc2s krb5kdc[26985](info): commencing operation
krb5kdc: starting...
W20260812 07:03:05.862691 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:03:06 dist-test-slave-tc2s krb5kdc[26985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518186, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:03:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:03:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:03:06.112598 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:34095
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:42775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:34095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:03:06.436643 27013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:06.437074 27013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:06.437249 27013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:06.444610 27013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:06.444716 27013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:06.444792 27013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:06.444875 27013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:06.444934 27013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:06.454250 27013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:42775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:34095
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:34095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:06.455349 27013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:06.456570 27013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:06.467417 27022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:06.467486 27023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:06.467456 27029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:06.468062 27013 server_base.cc:1034] running on GCE node
I20260812 07:03:06.468747 27013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:06.469976 27013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:06.471174 27013 hybrid_clock.cc:648] HybridClock initialized: now 1786518186471124 us; error 43 us; skew 500 ppm
I20260812 07:03:06.471470 27013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:06 dist-test-slave-tc2s krb5kdc[26985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518186, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:06.474335 27013 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:03:06.475627 27013 webserver.cc:460] Webserver started at http://127.18.70.190:41261/ using document root <none> and password file <none>
I20260812 07:03:06.476222 27013 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:06.476327 27013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:06.476601 27013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:06.479405 27013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "2ab51f99d9af4f7c854fd3788c0eb1bd"
format_stamp: "Formatted at 2026-08-12 07:03:06 on dist-test-slave-tc2s"
server_key: "6a5f68240ee9cb4954ad73021798c003"
server_key_iv: "9ebc0c2f5e9fa19e381ac0416740141e"
server_key_version: "encryptionkey@0"
I20260812 07:03:06.480121 27013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "2ab51f99d9af4f7c854fd3788c0eb1bd"
format_stamp: "Formatted at 2026-08-12 07:03:06 on dist-test-slave-tc2s"
server_key: "6a5f68240ee9cb4954ad73021798c003"
server_key_iv: "9ebc0c2f5e9fa19e381ac0416740141e"
server_key_version: "encryptionkey@0"
I20260812 07:03:06.484818 27013 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 07:03:06.487974 27038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:06.489279 27013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 07:03:06.489459 27013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "2ab51f99d9af4f7c854fd3788c0eb1bd"
format_stamp: "Formatted at 2026-08-12 07:03:06 on dist-test-slave-tc2s"
server_key: "6a5f68240ee9cb4954ad73021798c003"
server_key_iv: "9ebc0c2f5e9fa19e381ac0416740141e"
server_key_version: "encryptionkey@0"
I20260812 07:03:06.489637 27013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:06.504787 27013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:06.508363 27013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:06.508603 27013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:06.525709 27013 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:34095
I20260812 07:03:06.525740 27149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:34095 every 8 connection(s)
I20260812 07:03:06.526953 27013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:03:06.530560 27152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:06.534996 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 27013
I20260812 07:03:06.535192 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:03:06.535759 18714 external_mini_cluster.cc:1428] Setting key 4075420e24c3e1637e8759283db2ea29
I20260812 07:03:06.541596 27152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd: Bootstrap starting.
I20260812 07:03:06.544986 27152 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:06.546201 27152 log.cc:824] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:06.548971 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:06.537445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33295 (local address 127.18.70.190:34095)
0812 07:03:06.538195 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:06.538208 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:06.538251 (+ 43us) server_negotiation.cc:407] Connection header received
0812 07:03:06.540213 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:06.540235 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:06.540589 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:06.540895 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:06.541461 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:06.542811 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:06.544639 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:06.545347 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:06.545476 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:06.546676 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:06.546686 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:06.546704 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:06.547432 (+ 728us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:06.547519 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:06.547560 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:06.547676 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:06.547928 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 07:03:06.548079 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":373,"threads_started":1}
I20260812 07:03:06.549113 27152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd: No bootstrap required, opened a new log
I20260812 07:03:06.552433 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:03:06.558357 27152 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ab51f99d9af4f7c854fd3788c0eb1bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34095 } }
I20260812 07:03:06.558771 27152 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:03:06.558885 27152 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ab51f99d9af4f7c854fd3788c0eb1bd, State: Initialized, Role: FOLLOWER
I20260812 07:03:06.559453 27152 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ab51f99d9af4f7c854fd3788c0eb1bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34095 } }
I20260812 07:03:06.559689 27152 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:03:06.559823 27152 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:03:06.559985 27152 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:06.562985 27152 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ab51f99d9af4f7c854fd3788c0eb1bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34095 } }
I20260812 07:03:06.563526 27152 leader_election.cc:302] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ab51f99d9af4f7c854fd3788c0eb1bd; no voters:
I20260812 07:03:06.564172 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:06.557486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47929 (local address 127.18.70.190:34095)
0812 07:03:06.557680 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:06.557686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:06.558157 (+ 471us) server_negotiation.cc:407] Connection header received
0812 07:03:06.558340 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:06.558344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:06.558396 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:06.558465 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:06.559078 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:06.559960 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:06.561752 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:06.562237 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:06.562333 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:06.563394 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:06.563398 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:06.563401 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:06.563416 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:06.563472 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:06.563491 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:06.563583 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:06.563814 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 07:03:06.563857 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 07:03:06.564199 27152 leader_election.cc:288] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:03:06.564291 27167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:03:06.565688 27167 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [term 1 LEADER]: Becoming Leader. State: Replica: 2ab51f99d9af4f7c854fd3788c0eb1bd, State: Running, Role: LEADER
I20260812 07:03:06.566393 27152 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:06.566310 27167 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ab51f99d9af4f7c854fd3788c0eb1bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34095 } }
I20260812 07:03:06.569151 27169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ab51f99d9af4f7c854fd3788c0eb1bd. Latest consensus state: current_term: 1 leader_uuid: "2ab51f99d9af4f7c854fd3788c0eb1bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ab51f99d9af4f7c854fd3788c0eb1bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34095 } } }
I20260812 07:03:06.569226 27168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ab51f99d9af4f7c854fd3788c0eb1bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ab51f99d9af4f7c854fd3788c0eb1bd" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 34095 } } }
I20260812 07:03:06.569546 27169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:06.569576 27168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:06.570786 27173 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:03:06.575682 27173 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:03:06.584712 27173 catalog_manager.cc:1347] Generated new cluster ID: 98792023f71f41c7852e7b27a21f3e54
I20260812 07:03:06.584816 27173 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:03:06.598850 27173 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:03:06.600503 27173 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:03:06.613690 27173 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ab51f99d9af4f7c854fd3788c0eb1bd: Generated new TSK 0
I20260812 07:03:06.614609 27173 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:03:06.620493 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27013
W20260812 07:03:06.621570 27138 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33295
W20260812 07:03:06.622310 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27013: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:03:06.622457 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 27013
W20260812 07:03:06.652222 26981 connection.cc:535] client connection to 127.18.70.190:34095 recv error: Network error: failed to read from TLS socket (remote: 127.18.70.190:34095): Connection reset by peer (error 104)
2026-08-12T07:03:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2016 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:03:06 dist-test-slave-tc2s krb5kdc[27202](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:03:06 dist-test-slave-tc2s krb5kdc[27202](info): set up 2 sockets
Aug 12 07:03:06 dist-test-slave-tc2s krb5kdc[27202](info): commencing operation
krb5kdc: starting...
W20260812 07:03:07.886689 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.001s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:03:08 dist-test-slave-tc2s krb5kdc[27202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:03:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:03:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:03:08.138851 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:42043
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:34737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:42043
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:03:08.462374 27228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:08.462637 27228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:08.462770 27228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:08.469762 27228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:08.469882 27228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:08.469974 27228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:08.470041 27228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:08.470084 27228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:08.479385 27228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:34737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:42043
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:42043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:08.480568 27228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:08.481788 27228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:08.492977 27239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:08.493022 27242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:08.493021 27238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:08.494174 27228 server_base.cc:1034] running on GCE node
I20260812 07:03:08.494911 27228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:08.496165 27228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:08.497371 27228 hybrid_clock.cc:648] HybridClock initialized: now 1786518188497313 us; error 39 us; skew 500 ppm
I20260812 07:03:08.497681 27228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:08 dist-test-slave-tc2s krb5kdc[27202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518188, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:08.507521 27228 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:03:08.508951 27228 webserver.cc:460] Webserver started at http://127.18.70.190:38953/ using document root <none> and password file <none>
I20260812 07:03:08.509615 27228 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:08.509735 27228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:08.510071 27228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:08.512943 27228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "21eeb27b91444c0abd55a5ba950f64f7"
format_stamp: "Formatted at 2026-08-12 07:03:08 on dist-test-slave-tc2s"
server_key: "156d52097692275445d73d93fa688099"
server_key_iv: "a62899a77ad7c92c60d5b5bdc4f27eeb"
server_key_version: "encryptionkey@0"
I20260812 07:03:08.513686 27228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "21eeb27b91444c0abd55a5ba950f64f7"
format_stamp: "Formatted at 2026-08-12 07:03:08 on dist-test-slave-tc2s"
server_key: "156d52097692275445d73d93fa688099"
server_key_iv: "a62899a77ad7c92c60d5b5bdc4f27eeb"
server_key_version: "encryptionkey@0"
I20260812 07:03:08.518666 27228 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260812 07:03:08.521987 27253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:08.523175 27228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 07:03:08.523339 27228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "21eeb27b91444c0abd55a5ba950f64f7"
format_stamp: "Formatted at 2026-08-12 07:03:08 on dist-test-slave-tc2s"
server_key: "156d52097692275445d73d93fa688099"
server_key_iv: "a62899a77ad7c92c60d5b5bdc4f27eeb"
server_key_version: "encryptionkey@0"
I20260812 07:03:08.523528 27228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:08.529026 27228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:08.532768 27228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:08.533031 27228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:08.550179 27228 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:42043
I20260812 07:03:08.550204 27360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:42043 every 8 connection(s)
I20260812 07:03:08.551419 27228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:03:08.554778 27361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:08.561398 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 27228
I20260812 07:03:08.561555 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:03:08.562050 18714 external_mini_cluster.cc:1428] Setting key 3f4778235cb80d7e6ffd17b9d042aab3
I20260812 07:03:08.564687 27361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7: Bootstrap starting.
I20260812 07:03:08.567957 27361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:08.569041 27361 log.cc:824] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:08.569311 27368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:08.563640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44021 (local address 127.18.70.190:42043)
0812 07:03:08.564439 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:08.564450 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:08.564490 (+ 40us) server_negotiation.cc:407] Connection header received
0812 07:03:08.566231 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:08.566256 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:08.566560 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:08.566862 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:08.567837 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:08.567844 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:08.567871 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:08.567885 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:08.567944 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:08.567966 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:08.568129 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:08.568239 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 07:03:08.568413 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":339,"threads_started":1}
I20260812 07:03:08.571738 27361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7: No bootstrap required, opened a new log
I20260812 07:03:08.572672 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:03:08.579190 27368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:08.576792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52795 (local address 127.18.70.190:42043)
0812 07:03:08.576989 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:08.576995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:08.577466 (+ 471us) server_negotiation.cc:407] Connection header received
0812 07:03:08.577607 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:08.577610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:08.577665 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:08.577744 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:08.578615 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:08.578619 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:08.578626 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:08.578641 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:08.578679 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:08.578694 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:08.578785 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:08.578902 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 07:03:08.578943 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 07:03:08.579531 27361 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21eeb27b91444c0abd55a5ba950f64f7" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42043 } }
I20260812 07:03:08.579900 27361 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:03:08.580003 27361 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21eeb27b91444c0abd55a5ba950f64f7, State: Initialized, Role: FOLLOWER
I20260812 07:03:08.580545 27361 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21eeb27b91444c0abd55a5ba950f64f7" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42043 } }
I20260812 07:03:08.580758 27361 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:03:08.580888 27361 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:03:08.581037 27361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:08.583191 27361 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21eeb27b91444c0abd55a5ba950f64f7" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42043 } }
I20260812 07:03:08.583652 27361 leader_election.cc:302] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21eeb27b91444c0abd55a5ba950f64f7; no voters:
I20260812 07:03:08.584116 27361 leader_election.cc:288] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:03:08.584236 27382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:03:08.584848 27382 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [term 1 LEADER]: Becoming Leader. State: Replica: 21eeb27b91444c0abd55a5ba950f64f7, State: Running, Role: LEADER
I20260812 07:03:08.585315 27382 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21eeb27b91444c0abd55a5ba950f64f7" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42043 } }
I20260812 07:03:08.585920 27361 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:08.588084 27386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21eeb27b91444c0abd55a5ba950f64f7. Latest consensus state: current_term: 1 leader_uuid: "21eeb27b91444c0abd55a5ba950f64f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21eeb27b91444c0abd55a5ba950f64f7" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42043 } } }
I20260812 07:03:08.588488 27386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:08.589203 27385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21eeb27b91444c0abd55a5ba950f64f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21eeb27b91444c0abd55a5ba950f64f7" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 42043 } } }
I20260812 07:03:08.589486 27385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7 [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:08.590814 27393 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:03:08.596101 27393 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:03:08.603897 27393 catalog_manager.cc:1347] Generated new cluster ID: 24f129890811423ab1c80e1eb3dca49a
I20260812 07:03:08.603991 27393 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:03:08.614938 27393 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:03:08.615321 27393 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:03:08.625643 27393 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21eeb27b91444c0abd55a5ba950f64f7: Generated new TSK 0
I20260812 07:03:08.626432 27393 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:03:08.639086 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27228
W20260812 07:03:08.640245 27349 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44021
W20260812 07:03:08.640888 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27228: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:03:08.641012 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 27228
2026-08-12T07:03:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2013 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:03:08 dist-test-slave-tc2s krb5kdc[27421](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:03:08 dist-test-slave-tc2s krb5kdc[27421](info): set up 2 sockets
Aug 12 07:03:08 dist-test-slave-tc2s krb5kdc[27421](info): commencing operation
krb5kdc: starting...
W20260812 07:03:09.908192 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:03:10 dist-test-slave-tc2s krb5kdc[27421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:03:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:03:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:03:10.171252 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:37229
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:43527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:37229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:03:10.509152 27441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:10.509418 27441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:10.509542 27441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:10.516458 27441 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:10.516561 27441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:10.516638 27441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:10.516719 27441 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:10.516777 27441 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:10.526093 27441 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:43527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:37229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:37229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:10.527209 27441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:10.528406 27441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:10.539310 27453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:10.539506 27460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:10.539598 27454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:10.540405 27441 server_base.cc:1034] running on GCE node
I20260812 07:03:10.541115 27441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:10.542387 27441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:10.543581 27441 hybrid_clock.cc:648] HybridClock initialized: now 1786518190543544 us; error 26 us; skew 500 ppm
I20260812 07:03:10.543895 27441 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:10 dist-test-slave-tc2s krb5kdc[27421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518190, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:10.546842 27441 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:03:10.548211 27441 webserver.cc:460] Webserver started at http://127.18.70.190:38721/ using document root <none> and password file <none>
I20260812 07:03:10.548820 27441 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:10.548920 27441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:10.549171 27441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:10.552037 27441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "c3d416faf76442929737620066dace2c"
format_stamp: "Formatted at 2026-08-12 07:03:10 on dist-test-slave-tc2s"
server_key: "84d304780e85156d4d4017a7ce9b9865"
server_key_iv: "78db00272808295cf8dc83ea1ce16f93"
server_key_version: "encryptionkey@0"
I20260812 07:03:10.552738 27441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "c3d416faf76442929737620066dace2c"
format_stamp: "Formatted at 2026-08-12 07:03:10 on dist-test-slave-tc2s"
server_key: "84d304780e85156d4d4017a7ce9b9865"
server_key_iv: "78db00272808295cf8dc83ea1ce16f93"
server_key_version: "encryptionkey@0"
I20260812 07:03:10.557480 27441 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 07:03:10.560690 27472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:10.561939 27441 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 07:03:10.562095 27441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "c3d416faf76442929737620066dace2c"
format_stamp: "Formatted at 2026-08-12 07:03:10 on dist-test-slave-tc2s"
server_key: "84d304780e85156d4d4017a7ce9b9865"
server_key_iv: "78db00272808295cf8dc83ea1ce16f93"
server_key_version: "encryptionkey@0"
I20260812 07:03:10.562273 27441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:10.581671 27441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:10.585394 27441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:10.585626 27441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:10.602708 27441 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:37229
I20260812 07:03:10.602744 27554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:37229 every 8 connection(s)
I20260812 07:03:10.603899 27441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:03:10.607407 27555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:10.609100 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 27441
I20260812 07:03:10.609247 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:03:10.609683 18714 external_mini_cluster.cc:1428] Setting key aef92e5224af3f47676a3d8de4b1b24f
I20260812 07:03:10.620684 27555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c: Bootstrap starting.
Aug 12 07:03:10 dist-test-slave-tc2s krb5kdc[27421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:03:10.624396 27555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:10.625571 27555 log.cc:824] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:10.628427 27555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c: No bootstrap required, opened a new log
I20260812 07:03:10.632220 27561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:10.611381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36123 (local address 127.18.70.190:37229)
0812 07:03:10.612154 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:10.612167 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:10.612208 (+ 41us) server_negotiation.cc:407] Connection header received
0812 07:03:10.613790 (+ 1582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:10.613814 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:10.614209 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:10.614503 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:10.616368 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:10.617656 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:10.619522 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:10.620149 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:10.620272 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:10.625099 (+ 4827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:10.625107 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:10.625119 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:10.625158 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:10.628324 (+ 3166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:10.629112 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:10.629119 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:10.629125 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:10.629282 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:10.629663 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:10.629665 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:10.629668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:10.630222 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:10.630482 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:10.630884 (+ 402us) server_negotiation.cc:299] Negotiation successful
0812 07:03:10.631210 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":348,"threads_started":1}
I20260812 07:03:10.636032 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:03:10.637226 27555 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d416faf76442929737620066dace2c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37229 } }
I20260812 07:03:10.637555 27555 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:03:10.637650 27555 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d416faf76442929737620066dace2c, State: Initialized, Role: FOLLOWER
I20260812 07:03:10.638227 27555 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d416faf76442929737620066dace2c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37229 } }
I20260812 07:03:10.638475 27555 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:03:10.638605 27555 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:03:10.638767 27555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:10.641085 27555 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d416faf76442929737620066dace2c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37229 } }
I20260812 07:03:10.641546 27555 leader_election.cc:302] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d416faf76442929737620066dace2c; no voters:
I20260812 07:03:10.642107 27555 leader_election.cc:288] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:03:10.642242 27579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:03:10.642843 27579 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [term 1 LEADER]: Becoming Leader. State: Replica: c3d416faf76442929737620066dace2c, State: Running, Role: LEADER
I20260812 07:03:10.643414 27579 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d416faf76442929737620066dace2c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37229 } }
I20260812 07:03:10.645265 27579 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3d416faf76442929737620066dace2c. Latest consensus state: current_term: 1 leader_uuid: "c3d416faf76442929737620066dace2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d416faf76442929737620066dace2c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37229 } } }
I20260812 07:03:10.645524 27579 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:10.646136 27581 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3d416faf76442929737620066dace2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d416faf76442929737620066dace2c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 37229 } } }
I20260812 07:03:10.646481 27581 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:10.650108 27555 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:10.651199 27585 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:03:10.656411 27585 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:03:10.658390 27561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:10.640284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43973 (local address 127.18.70.190:37229)
0812 07:03:10.640487 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:10.640493 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:10.640981 (+ 488us) server_negotiation.cc:407] Connection header received
0812 07:03:10.641141 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:10.641145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:10.641204 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:10.641280 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:10.643062 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:10.644111 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:10.645884 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:10.646645 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:10.646745 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:10.650034 (+ 3289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:10.650040 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:10.650054 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:10.650098 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:10.654140 (+ 4042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:10.655043 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:10.655049 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:10.655053 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:10.655230 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:10.655736 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:10.655741 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:10.655745 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:10.656260 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:10.657556 (+ 1296us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:10.657721 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 07:03:10.657995 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 07:03:10.666113 27585 catalog_manager.cc:1347] Generated new cluster ID: 22c6a228bce3400eb98307c47c5bf668
I20260812 07:03:10.666227 27585 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:03:10.685483 27585 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:03:10.686954 27585 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:03:10.694983 27585 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3d416faf76442929737620066dace2c: Generated new TSK 0
I20260812 07:03:10.695811 27585 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:03:10.709403 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27441
I20260812 07:03:10.710554 27546 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:03:10.800910 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 27441
2026-08-12T07:03:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2161 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:03:10 dist-test-slave-tc2s krb5kdc[27632](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:03:10 dist-test-slave-tc2s krb5kdc[27632](info): set up 2 sockets
Aug 12 07:03:10 dist-test-slave-tc2s krb5kdc[27632](info): commencing operation
krb5kdc: starting...
W20260812 07:03:12.065290 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.002s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:03:12 dist-test-slave-tc2s krb5kdc[27632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:03:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:03:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:03:12.330340 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:38637
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:41827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:38637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:03:12.658104 27656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:12.658387 27656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:12.658530 27656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:12.665515 27656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:12.665622 27656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:12.665704 27656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:12.665791 27656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:12.665853 27656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:12.675266 27656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:41827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:38637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:38637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:12.676446 27656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:12.677667 27656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:12.688803 27662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:12.688761 27665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:12.688839 27669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:12.689594 27656 server_base.cc:1034] running on GCE node
I20260812 07:03:12.690379 27656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:12.691598 27656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:12.692808 27656 hybrid_clock.cc:648] HybridClock initialized: now 1786518192692757 us; error 39 us; skew 500 ppm
I20260812 07:03:12.693130 27656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:12 dist-test-slave-tc2s krb5kdc[27632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518192, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:12.696025 27656 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:03:12.697412 27656 webserver.cc:460] Webserver started at http://127.18.70.190:38127/ using document root <none> and password file <none>
I20260812 07:03:12.698078 27656 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:12.698205 27656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:12.698494 27656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:12.701316 27656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "149e1d343a7141c6bc1a0d64860f1348"
format_stamp: "Formatted at 2026-08-12 07:03:12 on dist-test-slave-tc2s"
server_key: "6392fab668a1995ccf0b78e3b2e65811"
server_key_iv: "b2b72294a3faefec7b87a6e20b26ddeb"
server_key_version: "encryptionkey@0"
I20260812 07:03:12.702092 27656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "149e1d343a7141c6bc1a0d64860f1348"
format_stamp: "Formatted at 2026-08-12 07:03:12 on dist-test-slave-tc2s"
server_key: "6392fab668a1995ccf0b78e3b2e65811"
server_key_iv: "b2b72294a3faefec7b87a6e20b26ddeb"
server_key_version: "encryptionkey@0"
I20260812 07:03:12.706830 27656 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 07:03:12.710018 27681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:12.711166 27656 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 07:03:12.711316 27656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "149e1d343a7141c6bc1a0d64860f1348"
format_stamp: "Formatted at 2026-08-12 07:03:12 on dist-test-slave-tc2s"
server_key: "6392fab668a1995ccf0b78e3b2e65811"
server_key_iv: "b2b72294a3faefec7b87a6e20b26ddeb"
server_key_version: "encryptionkey@0"
I20260812 07:03:12.711480 27656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:12.745455 27656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:12.749225 27656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:12.749487 27656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:12.766986 27656 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:38637
I20260812 07:03:12.767022 27770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:38637 every 8 connection(s)
I20260812 07:03:12.768256 27656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:03:12.771756 27771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:12.773489 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 27656
I20260812 07:03:12.773682 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:03:12.774277 18714 external_mini_cluster.cc:1428] Setting key 49b8d09c428bb376e52152c998cc723b
I20260812 07:03:12.785380 27771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348: Bootstrap starting.
I20260812 07:03:12.787179 27774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:12.776128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48263 (local address 127.18.70.190:38637)
0812 07:03:12.776934 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:12.776947 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:12.776994 (+ 47us) server_negotiation.cc:407] Connection header received
0812 07:03:12.778647 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:12.778670 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:12.779050 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:12.779336 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:12.779901 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:12.781125 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:12.782969 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:12.783625 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:12.783753 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:12.784986 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:12.784994 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:12.785010 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:12.785557 (+ 547us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:12.785639 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:12.785670 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:12.785751 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:12.786013 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 07:03:12.786249 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":351,"threads_started":1}
I20260812 07:03:12.788663 27771 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:12.789772 27771 log.cc:824] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:12.790580 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:03:12.792335 27771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348: No bootstrap required, opened a new log
I20260812 07:03:12.800855 27774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:12.794663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50891 (local address 127.18.70.190:38637)
0812 07:03:12.794843 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:12.794849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:12.795325 (+ 476us) server_negotiation.cc:407] Connection header received
0812 07:03:12.795476 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:12.795481 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:12.795557 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:12.795671 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:12.796108 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:12.797203 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:12.798456 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:12.799150 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:12.799288 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:12.800188 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:12.800195 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:12.800200 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:12.800220 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:12.800265 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:12.800284 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:12.800384 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:12.800475 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 07:03:12.800557 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 07:03:12.801051 27771 raft_consensus.cc:348] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e1d343a7141c6bc1a0d64860f1348" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38637 } }
I20260812 07:03:12.801442 27771 raft_consensus.cc:374] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:03:12.801555 27771 raft_consensus.cc:729] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 149e1d343a7141c6bc1a0d64860f1348, State: Initialized, Role: FOLLOWER
I20260812 07:03:12.802356 27771 consensus_queue.cc:260] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e1d343a7141c6bc1a0d64860f1348" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38637 } }
I20260812 07:03:12.802656 27771 raft_consensus.cc:388] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:03:12.802771 27771 raft_consensus.cc:482] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:03:12.802898 27771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:12.804986 27771 raft_consensus.cc:504] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e1d343a7141c6bc1a0d64860f1348" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38637 } }
I20260812 07:03:12.805428 27771 leader_election.cc:302] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 149e1d343a7141c6bc1a0d64860f1348; no voters:
I20260812 07:03:12.806054 27771 leader_election.cc:288] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:03:12.806176 27785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:03:12.806843 27785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [term 1 LEADER]: Becoming Leader. State: Replica: 149e1d343a7141c6bc1a0d64860f1348, State: Running, Role: LEADER
I20260812 07:03:12.807397 27785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e1d343a7141c6bc1a0d64860f1348" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38637 } }
I20260812 07:03:12.808144 27771 sys_catalog.cc:564] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:12.810151 27788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 149e1d343a7141c6bc1a0d64860f1348. Latest consensus state: current_term: 1 leader_uuid: "149e1d343a7141c6bc1a0d64860f1348" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e1d343a7141c6bc1a0d64860f1348" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38637 } } }
I20260812 07:03:12.810642 27788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:12.810178 27786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "149e1d343a7141c6bc1a0d64860f1348" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e1d343a7141c6bc1a0d64860f1348" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 38637 } } }
I20260812 07:03:12.811319 27786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348 [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:12.816476 27795 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:03:12.821666 27795 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:03:12.829449 27795 catalog_manager.cc:1347] Generated new cluster ID: 17294b57ca4549489ffbb3bc6bf6e521
I20260812 07:03:12.829560 27795 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:03:12.852085 27795 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:03:12.853936 27795 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:03:12.863247 27795 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 149e1d343a7141c6bc1a0d64860f1348: Generated new TSK 0
I20260812 07:03:12.864203 27795 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:03:12.870132 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27656
W20260812 07:03:12.871271 27766 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48263
W20260812 07:03:12.871938 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27656: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:03:12.872088 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 27656
2026-08-12T07:03:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2075 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:03:12 dist-test-slave-tc2s krb5kdc[27831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:03:12 dist-test-slave-tc2s krb5kdc[27831](info): set up 2 sockets
Aug 12 07:03:12 dist-test-slave-tc2s krb5kdc[27831](info): commencing operation
krb5kdc: starting...
W20260812 07:03:14.161077 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.002s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:03:14 dist-test-slave-tc2s krb5kdc[27831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:03:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:03:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:03:14.432605 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46751
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:41591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:46751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:03:14.759251 27855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:14.759505 27855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:14.759601 27855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:14.766465 27855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:14.766561 27855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:14.766607 27855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:14.766667 27855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:14.766710 27855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:14.775862 27855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:41591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:46751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:14.776933 27855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:14.778173 27855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:14.789309 27867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:14.789340 27869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:14.789340 27872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:14.790213 27855 server_base.cc:1034] running on GCE node
I20260812 07:03:14.790941 27855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:14.792181 27855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:14.793376 27855 hybrid_clock.cc:648] HybridClock initialized: now 1786518194793330 us; error 42 us; skew 500 ppm
I20260812 07:03:14.793695 27855 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:14 dist-test-slave-tc2s krb5kdc[27831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518194, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:14.805564 27855 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:03:14.807124 27855 webserver.cc:460] Webserver started at http://127.18.70.190:42595/ using document root <none> and password file <none>
I20260812 07:03:14.807785 27855 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:14.807904 27855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:14.808193 27855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:14.811141 27855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "fb1b281f74c94fafb800d1d8e3c95025"
format_stamp: "Formatted at 2026-08-12 07:03:14 on dist-test-slave-tc2s"
server_key: "e50242c0dbc8fbe792dec89fe55b3a09"
server_key_iv: "44f2da7214c9d05a7116737474f6dd8c"
server_key_version: "encryptionkey@0"
I20260812 07:03:14.811877 27855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "fb1b281f74c94fafb800d1d8e3c95025"
format_stamp: "Formatted at 2026-08-12 07:03:14 on dist-test-slave-tc2s"
server_key: "e50242c0dbc8fbe792dec89fe55b3a09"
server_key_iv: "44f2da7214c9d05a7116737474f6dd8c"
server_key_version: "encryptionkey@0"
I20260812 07:03:14.816742 27855 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 07:03:14.820003 27888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:14.821256 27855 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 07:03:14.821419 27855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "fb1b281f74c94fafb800d1d8e3c95025"
format_stamp: "Formatted at 2026-08-12 07:03:14 on dist-test-slave-tc2s"
server_key: "e50242c0dbc8fbe792dec89fe55b3a09"
server_key_iv: "44f2da7214c9d05a7116737474f6dd8c"
server_key_version: "encryptionkey@0"
I20260812 07:03:14.821585 27855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:14.827055 27855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:14.830716 27855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:14.830989 27855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:14.847965 27855 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:46751
I20260812 07:03:14.847997 27977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:46751 every 8 connection(s)
I20260812 07:03:14.849334 27855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:03:14.854651 27980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:14.857016 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 27855
I20260812 07:03:14.857189 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:03:14.857760 18714 external_mini_cluster.cc:1428] Setting key cf2868eaf1e2d1cdb8f4e2b5cf711023
I20260812 07:03:14.865178 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:14.859628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53329 (local address 127.18.70.190:46751)
0812 07:03:14.860395 (+ 767us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:14.860405 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:14.860460 (+ 55us) server_negotiation.cc:407] Connection header received
0812 07:03:14.862104 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:14.862126 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:14.862414 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:14.862742 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:14.863695 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:14.863701 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:14.863712 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:14.863734 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:14.863795 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:14.863816 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:14.864041 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:14.864173 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 07:03:14.864339 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":344,"threads_started":1}
I20260812 07:03:14.866462 27980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025: Bootstrap starting.
I20260812 07:03:14.868456 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:03:14.869490 27980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:14.870458 27980 log.cc:824] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:14.872865 27980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025: No bootstrap required, opened a new log
I20260812 07:03:14.876989 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:14.874567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37083 (local address 127.18.70.190:46751)
0812 07:03:14.874726 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:14.874731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:14.875148 (+ 417us) server_negotiation.cc:407] Connection header received
0812 07:03:14.875278 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:14.875283 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:14.875337 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:14.875451 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:14.876379 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:14.876384 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:14.876389 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 07:03:14.876411 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:14.876458 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 07:03:14.876478 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:14.876595 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:14.876662 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 07:03:14.876717 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 07:03:14.880788 27980 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b281f74c94fafb800d1d8e3c95025" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46751 } }
I20260812 07:03:14.881093 27980 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 07:03:14.881186 27980 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb1b281f74c94fafb800d1d8e3c95025, State: Initialized, Role: FOLLOWER
I20260812 07:03:14.881690 27980 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b281f74c94fafb800d1d8e3c95025" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46751 } }
I20260812 07:03:14.881925 27980 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 07:03:14.882055 27980 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 07:03:14.882206 27980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:14.884266 27980 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b281f74c94fafb800d1d8e3c95025" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46751 } }
I20260812 07:03:14.884724 27980 leader_election.cc:302] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb1b281f74c94fafb800d1d8e3c95025; no voters:
I20260812 07:03:14.885234 27980 leader_election.cc:288] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 07:03:14.885353 27998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:03:14.885979 27998 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [term 1 LEADER]: Becoming Leader. State: Replica: fb1b281f74c94fafb800d1d8e3c95025, State: Running, Role: LEADER
I20260812 07:03:14.886507 27998 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b281f74c94fafb800d1d8e3c95025" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46751 } }
I20260812 07:03:14.887082 27980 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:14.889151 28001 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb1b281f74c94fafb800d1d8e3c95025" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b281f74c94fafb800d1d8e3c95025" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46751 } } }
I20260812 07:03:14.889240 28002 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb1b281f74c94fafb800d1d8e3c95025. Latest consensus state: current_term: 1 leader_uuid: "fb1b281f74c94fafb800d1d8e3c95025" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb1b281f74c94fafb800d1d8e3c95025" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46751 } } }
I20260812 07:03:14.889640 28002 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:14.889631 28001 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025 [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:14.891078 28006 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:03:14.895777 28006 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:03:14.903887 28006 catalog_manager.cc:1347] Generated new cluster ID: def98cc81dff442e83b588c7bcf06e97
I20260812 07:03:14.904031 28006 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:03:14.919570 28006 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:03:14.919911 28006 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:03:14.930833 28006 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb1b281f74c94fafb800d1d8e3c95025: Generated new TSK 0
I20260812 07:03:14.931520 28006 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:03:14.940433 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27855
W20260812 07:03:14.941571 27967 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53329
W20260812 07:03:14.942209 18714 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 27855: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 07:03:14.942335 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 27855
2026-08-12T07:03:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2068 ms)
[----------] 18 tests from AuthTokenIssuingTest (37566 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:03:15 dist-test-slave-tc2s krb5kdc[28043](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:03:15 dist-test-slave-tc2s krb5kdc[28043](info): set up 2 sockets
Aug 12 07:03:15 dist-test-slave-tc2s krb5kdc[28043](info): commencing operation
krb5kdc: starting...
W20260812 07:03:16.209343 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:03:16 dist-test-slave-tc2s krb5kdc[28043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:03:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:03:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:03:16.481019 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46353
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:43615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:46353,127.18.70.189:42913,127.18.70.188:46237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:03:16.808472 28070 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 07:03:16.808758 28070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:16.808853 28070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:16.808976 28070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:16.815981 28070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:16.816056 28070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:16.816118 28070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:16.816184 28070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:16.816268 28070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:16.825496 28070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:43615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:46353,127.18.70.189:42913,127.18.70.188:46237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:46353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:16.826642 28070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:16.827867 28070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:16.838943 28079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:16.838907 28081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:16.839169 28078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:16.839660 28070 server_base.cc:1034] running on GCE node
I20260812 07:03:16.840340 28070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:16.841531 28070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:16.842736 28070 hybrid_clock.cc:648] HybridClock initialized: now 1786518196842671 us; error 36 us; skew 500 ppm
I20260812 07:03:16.843046 28070 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:16 dist-test-slave-tc2s krb5kdc[28043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518196, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:16.846048 28070 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:03:16.847370 28070 webserver.cc:460] Webserver started at http://127.18.70.190:39177/ using document root <none> and password file <none>
I20260812 07:03:16.847993 28070 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:16.848091 28070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:16.848381 28070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:16.851191 28070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "1ea609ab560d4dcea18c9a26d6a60dd9"
format_stamp: "Formatted at 2026-08-12 07:03:16 on dist-test-slave-tc2s"
server_key: "5f29a54ba0b85b95643b2d544184f22b"
server_key_iv: "e1a0c2c1a05b0f900801ba0f84ad76ed"
server_key_version: "encryptionkey@0"
I20260812 07:03:16.851954 28070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "1ea609ab560d4dcea18c9a26d6a60dd9"
format_stamp: "Formatted at 2026-08-12 07:03:16 on dist-test-slave-tc2s"
server_key: "5f29a54ba0b85b95643b2d544184f22b"
server_key_iv: "e1a0c2c1a05b0f900801ba0f84ad76ed"
server_key_version: "encryptionkey@0"
I20260812 07:03:16.857632 28070 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 07:03:16.860878 28100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:16.862126 28070 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:03:16.862270 28070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "1ea609ab560d4dcea18c9a26d6a60dd9"
format_stamp: "Formatted at 2026-08-12 07:03:16 on dist-test-slave-tc2s"
server_key: "5f29a54ba0b85b95643b2d544184f22b"
server_key_iv: "e1a0c2c1a05b0f900801ba0f84ad76ed"
server_key_version: "encryptionkey@0"
I20260812 07:03:16.862463 28070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:16.879572 28070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:16.883198 28070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:16.883422 28070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:16.900332 28070 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:46353
I20260812 07:03:16.900384 28199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:46353 every 8 connection(s)
I20260812 07:03:16.901530 28070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:03:16.904227 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 28070
I20260812 07:03:16.904470 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:03:16.905293 18714 external_mini_cluster.cc:1428] Setting key 75038f618a9271bf4e11077e6baed801
I20260812 07:03:16.905426 28206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:16.913647 28206 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:03:16 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518196, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:03:16.933877 28212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:16.916490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45700 (local address 127.18.70.190:46353)
0812 07:03:16.918030 (+ 1540us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:16.918038 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:16.918093 (+ 55us) server_negotiation.cc:407] Connection header received
0812 07:03:16.919507 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:16.919512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:16.919715 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:16.919899 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:16.921113 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:16.922365 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:16.923682 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:16.924202 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:16.924359 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:16.927473 (+ 3114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:16.927480 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:16.927491 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:16.927524 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:16.930005 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:16.930627 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:16.930635 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:16.930637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:16.930779 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:16.931144 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:16.931148 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:16.931150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:16.931585 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:16.931764 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:16.932292 (+ 528us) server_negotiation.cc:299] Negotiation successful
0812 07:03:16.932553 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1300,"thread_start_us":1109,"threads_started":1}
I20260812 07:03:16.933936 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:16.916489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46353 (local address 127.0.0.1:45700)
0812 07:03:16.917229 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:16.917279 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:16.919176 (+ 1897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:16.919934 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:16.919940 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:16.920602 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:16.920923 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:16.920939 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:16.922510 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:16.922514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:16.923551 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:16.923564 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:16.924421 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:16.924429 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:16.924596 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:16.925198 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:16.925219 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:16.927271 (+ 2052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:16.930113 (+ 2842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:16.930124 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:16.930134 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:16.930511 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:16.930884 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:16.930889 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:16.930893 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:16.931045 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:16.931726 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:16.931733 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:16.931943 (+ 210us) client_negotiation.cc:769] Sending connection context
0812 07:03:16.932153 (+ 210us) client_negotiation.cc:240] Negotiation successful
0812 07:03:16.932709 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"mutex_wait_us":112,"thread_start_us":308,"threads_started":1}
WARNING: no policy specified for kudu/127.18.70.189@KRBTEST.COM; defaulting to no policy
I20260812 07:03:16.936704 28206 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.189@KRBTEST.COM" created.
I20260812 07:03:16.937732 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:16.937315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34280)
0812 07:03:16.937505 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:16.937617 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260812 07:03:16.937985 28106 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
I20260812 07:03:16.939429 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:16.939081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34284)
0812 07:03:16.939238 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:16.939301 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 07:03:16.939606 28206 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:42913: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab.
Entry for principal kudu/127.18.70.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab.
I20260812 07:03:16.967244 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.189:42913
--webserver_interface=127.18.70.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab
--principal=kudu/127.18.70.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:43615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:46353,127.18.70.189:42913,127.18.70.188:46237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:03:16.988906 28206 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } attempt: 1
I20260812 07:03:16.990109 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:16.989616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34292)
0812 07:03:16.989818 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:16.989973 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260812 07:03:16.991094 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:16.990734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34306)
0812 07:03:16.990884 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:16.990961 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 07:03:16.991305 28206 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:42913: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
I20260812 07:03:17.059517 28206 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } attempt: 2
I20260812 07:03:17.060709 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.060234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34318)
0812 07:03:17.060472 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.060564 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260812 07:03:17.061688 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.061365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34328)
0812 07:03:17.061481 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.061562 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 07:03:17.061877 28206 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:42913: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
I20260812 07:03:17.153144 28206 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } attempt: 3
I20260812 07:03:17.154480 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.153877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34340)
0812 07:03:17.154219 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.154335 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 07:03:17.155519 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.155158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34346)
0812 07:03:17.155297 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.155376 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 07:03:17.155750 28206 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:42913: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
W20260812 07:03:17.294782 28216 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 07:03:17.295105 28216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:17.295212 28216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:17.295328 28216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 07:03:17.298959 28206 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } attempt: 4
I20260812 07:03:17.300184 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.299633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34358)
0812 07:03:17.299932 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.300021 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260812 07:03:17.301142 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.300835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34368)
0812 07:03:17.300953 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.301031 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 07:03:17.301301 28206 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:42913: Network error: Client connection negotiation failed: client connection to 127.18.70.189:42913: connect: Connection refused (error 111)
W20260812 07:03:17.302875 28216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:17.302953 28216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:17.303037 28216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:17.303097 28216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:17.303177 28216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:17.312526 28216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:43615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:46353,127.18.70.189:42913,127.18.70.188:46237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab
--principal=kudu/127.18.70.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.189:42913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.70.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:17.313639 28216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:17.314888 28216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:17.325968 28229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:17.325995 28234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:17.326179 28223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:17.326731 28216 server_base.cc:1034] running on GCE node
I20260812 07:03:17.327451 28216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:17.328637 28216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:17.329843 28216 hybrid_clock.cc:648] HybridClock initialized: now 1786518197329784 us; error 32 us; skew 500 ppm
I20260812 07:03:17.330161 28216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:17 dist-test-slave-tc2s krb5kdc[28043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518197, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:17.333024 28216 init.cc:377] Logged in from keytab as kudu/127.18.70.189@KRBTEST.COM (short username kudu)
I20260812 07:03:17.334378 28216 webserver.cc:460] Webserver started at http://127.18.70.189:46107/ using document root <none> and password file <none>
I20260812 07:03:17.334988 28216 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:17.335089 28216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:17.335377 28216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:17.338163 28216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/data/instance:
uuid: "c422ea7acf2045eebb3db8a9d85e3eca"
format_stamp: "Formatted at 2026-08-12 07:03:17 on dist-test-slave-tc2s"
server_key: "6470087da4a9aec70e2f1395904c32da"
server_key_iv: "9b09357628b080d2296339488c924d37"
server_key_version: "encryptionkey@0"
I20260812 07:03:17.338933 28216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/wal/instance:
uuid: "c422ea7acf2045eebb3db8a9d85e3eca"
format_stamp: "Formatted at 2026-08-12 07:03:17 on dist-test-slave-tc2s"
server_key: "6470087da4a9aec70e2f1395904c32da"
server_key_iv: "9b09357628b080d2296339488c924d37"
server_key_version: "encryptionkey@0"
I20260812 07:03:17.343739 28216 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 07:03:17.347124 28251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:17.348320 28216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 07:03:17.348483 28216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/wal
uuid: "c422ea7acf2045eebb3db8a9d85e3eca"
format_stamp: "Formatted at 2026-08-12 07:03:17 on dist-test-slave-tc2s"
server_key: "6470087da4a9aec70e2f1395904c32da"
server_key_iv: "9b09357628b080d2296339488c924d37"
server_key_version: "encryptionkey@0"
I20260812 07:03:17.348672 28216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:17.370441 28216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:17.374146 28216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:17.374392 28216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:17.391471 28216 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.189:42913
I20260812 07:03:17.391501 28347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.189:42913 every 8 connection(s)
I20260812 07:03:17.392705 28216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
I20260812 07:03:17.396142 28348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:17.402007 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 28216
I20260812 07:03:17.402211 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-1/wal/instance
I20260812 07:03:17.402773 18714 external_mini_cluster.cc:1428] Setting key 4e5a22578e8384ed240539bfba6618f0
I20260812 07:03:17.402611 28348 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:03:17 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518197, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:03:17.425022 28212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.405759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45710 (local address 127.18.70.190:46353)
0812 07:03:17.406007 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:17.406013 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:17.407495 (+ 1482us) server_negotiation.cc:407] Connection header received
0812 07:03:17.409963 (+ 2468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:17.409971 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:17.410091 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:17.410212 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:17.412109 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.412796 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.414797 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.415217 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.415323 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.418972 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:17.418978 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:17.418983 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:17.419019 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:17.422172 (+ 3153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.422856 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.422862 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.422865 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.423012 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.423370 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.423376 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.423379 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.423760 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:17.423924 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:17.424498 (+ 574us) server_negotiation.cc:299] Negotiation successful
0812 07:03:17.424718 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 07:03:17.425685 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.406271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46353 (local address 127.0.0.1:45710)
0812 07:03:17.407266 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.407339 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:17.409550 (+ 2211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:17.410554 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:17.410565 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:17.411223 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:17.411925 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.411950 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.412964 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.412970 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.414647 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.414662 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.415438 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.415447 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.415696 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.416346 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:17.416378 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:17.418754 (+ 2376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:17.422296 (+ 3542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.422303 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.422314 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.422720 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.423107 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.423110 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.423113 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.423264 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.423873 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:17.423879 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:17.424154 (+ 275us) client_negotiation.cc:769] Sending connection context
0812 07:03:17.424358 (+ 204us) client_negotiation.cc:240] Negotiation successful
0812 07:03:17.424694 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":381,"threads_started":1}
I20260812 07:03:17.427451 28348 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.18.70.188@KRBTEST.COM; defaulting to no policy
Aug 12 07:03:17 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518197, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.188@KRBTEST.COM" created.
I20260812 07:03:17.441715 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.428235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34372)
0812 07:03:17.428407 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.428426 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:17.428500 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:17.429486 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:17.429490 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:17.429865 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:17.430027 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.430036 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.431342 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.431348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.432282 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.432296 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.433161 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.433168 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.433378 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.434007 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:17.434039 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:17.436164 (+ 2125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:17.439538 (+ 3374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.439542 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.439545 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.439899 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.440270 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.440274 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.440276 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.440420 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.441048 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:17.441052 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:17.441162 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 07:03:17.441265 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 07:03:17.441454 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 07:03:17.442219 28353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.428473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34372 (local address 127.18.70.189:42913)
0812 07:03:17.429129 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:17.429134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:17.429158 (+ 24us) server_negotiation.cc:407] Connection header received
0812 07:03:17.429198 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:17.429203 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:17.429347 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:17.429474 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:17.430181 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.431215 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.432461 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.433025 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.433136 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.436394 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:17.436408 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:17.436441 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:17.436483 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:17.439386 (+ 2903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.440026 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.440034 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.440037 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.440178 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.440517 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.440521 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.440523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.440923 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:17.441123 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:17.441430 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 07:03:17.441670 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":383,"threads_started":1}
I20260812 07:03:17.444453 28348 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } has no permanent_uuid. Determining permanent_uuid...
I20260812 07:03:17.445641 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.445229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42574)
0812 07:03:17.445400 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.445501 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 07:03:17.445868 28254 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
I20260812 07:03:17.447322 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.447018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42584)
0812 07:03:17.447147 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.447221 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 07:03:17.447513 28348 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:46237: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab.
Entry for principal kudu/127.18.70.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab.
I20260812 07:03:17.471079 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.188:46237
--webserver_interface=127.18.70.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab
--principal=kudu/127.18.70.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:43615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:46353,127.18.70.189:42913,127.18.70.188:46237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:03:17.496809 28348 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } attempt: 1
I20260812 07:03:17.498023 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.497484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42592)
0812 07:03:17.497683 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.497805 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 07:03:17.498988 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.498624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42606)
0812 07:03:17.498769 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.498860 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 07:03:17.499210 28348 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:46237: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
I20260812 07:03:17.567423 28348 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } attempt: 2
I20260812 07:03:17.568642 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.568097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42620)
0812 07:03:17.568320 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.568439 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 07:03:17.569648 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.569281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42634)
0812 07:03:17.569423 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.569511 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 07:03:17.569839 28348 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:46237: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
I20260812 07:03:17.600512 28206 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } attempt: 5
Aug 12 07:03:17 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518196, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
I20260812 07:03:17.613683 28353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.601302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34380 (local address 127.18.70.189:42913)
0812 07:03:17.601484 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:17.601491 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:17.601581 (+ 90us) server_negotiation.cc:407] Connection header received
0812 07:03:17.601775 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:17.601781 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:17.601864 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:17.601986 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:17.602817 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.603528 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.604703 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.605170 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.605283 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.608602 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:17.608607 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:17.608610 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:17.608644 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:17.611092 (+ 2448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.611880 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.611883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.611885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.612008 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.612417 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.612420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.612422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.612686 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:17.612820 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:17.613291 (+ 471us) server_negotiation.cc:299] Negotiation successful
0812 07:03:17.613457 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 07:03:17.613853 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.601269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34380)
0812 07:03:17.601483 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.601504 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:17.601646 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:17.602050 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:17.602055 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:17.602478 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:17.602658 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.602669 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.603662 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.603668 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.604543 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.604562 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.605313 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.605319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.605554 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.606198 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:17.606215 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:17.608405 (+ 2190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:17.611227 (+ 2822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.611232 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.611236 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.611779 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.612112 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.612117 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.612121 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.612322 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.612855 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:17.612860 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:17.613057 (+ 197us) client_negotiation.cc:769] Sending connection context
0812 07:03:17.613219 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 07:03:17.613511 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 07:03:17.614977 28206 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } has no permanent_uuid. Determining permanent_uuid...
I20260812 07:03:17.615959 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.615520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42640)
0812 07:03:17.615705 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.615797 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 07:03:17.616910 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.616572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42648)
0812 07:03:17.616703 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.616796 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 07:03:17.617126 28206 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:46237: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
I20260812 07:03:17.661103 28348 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } attempt: 3
I20260812 07:03:17.662421 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.661795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42660)
0812 07:03:17.662094 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.662217 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260812 07:03:17.663559 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.663078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42662)
0812 07:03:17.663319 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.663419 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
W20260812 07:03:17.663805 28348 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:46237: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
I20260812 07:03:17.668321 28206 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } attempt: 1
I20260812 07:03:17.669261 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.668870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42670)
0812 07:03:17.669035 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.669113 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 07:03:17.670173 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.669863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42674)
0812 07:03:17.670003 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.670070 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 07:03:17.670377 28206 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:46237: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
I20260812 07:03:17.738602 28206 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } attempt: 2
I20260812 07:03:17.739828 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.739347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42676)
0812 07:03:17.739554 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.739645 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 07:03:17.740767 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.740461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42680)
0812 07:03:17.740583 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.740664 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 07:03:17.740994 28206 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:46237: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
W20260812 07:03:17.798107 28356 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 07:03:17.798401 28356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:17.798511 28356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:17.798611 28356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:17.805569 28356 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:17.805640 28356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:17.805723 28356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:17.805784 28356 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:17.805866 28356 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:17.807026 28348 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } attempt: 4
I20260812 07:03:17.808198 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.807643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42684)
0812 07:03:17.807882 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.807985 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 07:03:17.809173 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.808805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42700)
0812 07:03:17.808952 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.809044 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 07:03:17.809358 28348 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:46237: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
I20260812 07:03:17.815829 28356 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:43615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:46353,127.18.70.189:42913,127.18.70.188:46237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab
--principal=kudu/127.18.70.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.188:46237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.70.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:17.816936 28356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:17.818158 28356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:17.829137 28374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:17.829185 28370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:17.829226 28369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:17.830173 28356 server_base.cc:1034] running on GCE node
I20260812 07:03:17.830818 28356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:17.831956 28356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:17.833169 28356 hybrid_clock.cc:648] HybridClock initialized: now 1786518197833109 us; error 36 us; skew 500 ppm
I20260812 07:03:17.833457 28356 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:17 dist-test-slave-tc2s krb5kdc[28043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518197, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:17.836405 28356 init.cc:377] Logged in from keytab as kudu/127.18.70.188@KRBTEST.COM (short username kudu)
I20260812 07:03:17.837700 28356 webserver.cc:460] Webserver started at http://127.18.70.188:41013/ using document root <none> and password file <none>
I20260812 07:03:17.838351 28356 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:17.838449 28356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:17.838740 28356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:17.841600 28356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/data/instance:
uuid: "89ffcf84120b4cd59a79ff713daf0dde"
format_stamp: "Formatted at 2026-08-12 07:03:17 on dist-test-slave-tc2s"
server_key: "eb393ac84b4e759851c12a810c131929"
server_key_iv: "f0ff45b49a305886eab50b91aa658078"
server_key_version: "encryptionkey@0"
I20260812 07:03:17.842384 28356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/wal/instance:
uuid: "89ffcf84120b4cd59a79ff713daf0dde"
format_stamp: "Formatted at 2026-08-12 07:03:17 on dist-test-slave-tc2s"
server_key: "eb393ac84b4e759851c12a810c131929"
server_key_iv: "f0ff45b49a305886eab50b91aa658078"
server_key_version: "encryptionkey@0"
I20260812 07:03:17.847178 28206 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } attempt: 3
I20260812 07:03:17.847298 28356 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 07:03:17.848229 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.847780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42716)
0812 07:03:17.847994 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.848077 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 07:03:17.849174 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.848847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42724)
0812 07:03:17.848989 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.849064 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 07:03:17.849375 28206 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:46237: Network error: Client connection negotiation failed: client connection to 127.18.70.188:46237: connect: Connection refused (error 111)
I20260812 07:03:17.850968 28390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:17.852238 28356 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 07:03:17.852420 28356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/wal
uuid: "89ffcf84120b4cd59a79ff713daf0dde"
format_stamp: "Formatted at 2026-08-12 07:03:17 on dist-test-slave-tc2s"
server_key: "eb393ac84b4e759851c12a810c131929"
server_key_iv: "f0ff45b49a305886eab50b91aa658078"
server_key_version: "encryptionkey@0"
I20260812 07:03:17.852617 28356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:17.870381 28356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:17.874246 28356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:17.874472 28356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:17.890924 28356 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.188:46237
I20260812 07:03:17.890969 28511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.188:46237 every 8 connection(s)
I20260812 07:03:17.892118 28356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
I20260812 07:03:17.895169 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 28356
I20260812 07:03:17.895367 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786517832212618-18714-0/minicluster-data/master-2/wal/instance
I20260812 07:03:17.895838 28512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:17.895953 18714 external_mini_cluster.cc:1428] Setting key c11310e261645fb27beb00ab26393303
I20260812 07:03:17.905843 28512 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:03:17 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
Aug 12 07:03:17 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518197, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:03:17.917326 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.897675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42730 (local address 127.18.70.188:46237)
0812 07:03:17.898394 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:17.898405 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:17.898447 (+ 42us) server_negotiation.cc:407] Connection header received
0812 07:03:17.900362 (+ 1915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:17.900383 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:17.900725 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:17.901049 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:17.902551 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.903823 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.905027 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.905653 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.905805 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.910125 (+ 4320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:17.910135 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:17.910153 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:17.910195 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:17.913226 (+ 3031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.913950 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.913958 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.913966 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.914177 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.914576 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.914580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.914582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.915215 (+ 633us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:17.915512 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:17.916069 (+ 557us) server_negotiation.cc:299] Negotiation successful
0812 07:03:17.916420 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":334,"threads_started":1}
I20260812 07:03:17.923336 28519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.908679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:46353 (local address 127.0.0.1:45712)
0812 07:03:17.909461 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.909499 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:17.909702 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:17.910103 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:17.910110 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:17.910752 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:17.911032 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.911042 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.912358 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.912361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.913517 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.913533 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.914430 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.914437 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.914621 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.915264 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:17.915288 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:17.917360 (+ 2072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:17.920784 (+ 3424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.920796 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.920802 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.921292 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.921644 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.921647 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.921649 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.921767 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.922332 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:17.922339 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:17.922507 (+ 168us) client_negotiation.cc:769] Sending connection context
0812 07:03:17.922661 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 07:03:17.922930 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":421,"threads_started":1}
I20260812 07:03:17.923347 28212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.908641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45712 (local address 127.18.70.190:46353)
0812 07:03:17.908833 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:17.908839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:17.909588 (+ 749us) server_negotiation.cc:407] Connection header received
0812 07:03:17.909831 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:17.909838 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:17.909931 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:17.910034 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:17.911184 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.912205 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.913663 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.914231 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.914332 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.917675 (+ 3343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:17.917682 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:17.917687 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:17.917728 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:17.920667 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.921401 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.921405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.921408 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.921532 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.921867 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.921872 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.921874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.922178 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:17.922326 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:17.922803 (+ 477us) server_negotiation.cc:299] Negotiation successful
0812 07:03:17.923013 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 07:03:17.924566 28512 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:03:17 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
Aug 12 07:03:17 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518197, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
I20260812 07:03:17.934402 28520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.920008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45720 (local address 127.18.70.190:46353)
0812 07:03:17.920601 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:17.920605 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:17.920626 (+ 21us) server_negotiation.cc:407] Connection header received
0812 07:03:17.920663 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:17.920667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:17.920716 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:17.920823 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:17.922029 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.922837 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.924177 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.924685 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.924800 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.929138 (+ 4338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:17.929145 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:17.929150 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:17.929185 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:17.932094 (+ 2909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.932642 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.932646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.932648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.932757 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.933074 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.933078 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.933080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.933396 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:17.933662 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:17.933872 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 07:03:17.934098 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":318,"threads_started":1}
I20260812 07:03:17.937824 28519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.925187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:42913 (local address 127.0.0.1:34396)
0812 07:03:17.925323 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.925565 (+ 242us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:17.925664 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:17.926061 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:17.926066 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:17.926519 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:17.926693 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.926705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.927705 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.927709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.928844 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.928860 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.929716 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.929721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.929864 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.930307 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:17.930322 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:17.932392 (+ 2070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:17.935564 (+ 3172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.935569 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.935572 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.936045 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.936451 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.936456 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.936459 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.936633 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.937211 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:17.937214 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:17.937337 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 07:03:17.937445 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 07:03:17.937616 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 07:03:17.938136 28353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.925429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34396 (local address 127.18.70.189:42913)
0812 07:03:17.925621 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:17.925628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:17.925647 (+ 19us) server_negotiation.cc:407] Connection header received
0812 07:03:17.925773 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:17.925778 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:17.925863 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:17.925986 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:17.926904 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.927559 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.928981 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.929581 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.929709 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.932558 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:17.932563 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:17.932566 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:17.932596 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:17.935437 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.936202 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.936205 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.936207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.936348 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.936750 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.936756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.936762 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.937093 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:17.937254 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:17.937561 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 07:03:17.937773 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 07:03:17.938943 28512 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:03:17 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
Aug 12 07:03:17 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518197, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
I20260812 07:03:17.950261 28521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.935807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34406 (local address 127.18.70.189:42913)
0812 07:03:17.936349 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:17.936353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:17.936370 (+ 17us) server_negotiation.cc:407] Connection header received
0812 07:03:17.936411 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:17.936424 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:17.936487 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:17.936590 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:17.937991 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.938916 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.940268 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.940877 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.940963 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.945176 (+ 4213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:17.945181 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:17.945184 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:17.945211 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:17.947761 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.948467 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.948470 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.948472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.948582 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.948943 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.948946 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.948949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.949269 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:17.949547 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:17.949696 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 07:03:17.949871 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":248,"threads_started":1}
I20260812 07:03:17.951359 28519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.939531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42734)
0812 07:03:17.939644 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:17.939656 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:17.939723 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:17.940050 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:17.940054 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:17.940478 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:17.940630 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.940641 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.941760 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.941764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.942654 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:17.942666 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.943551 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.943555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:17.943736 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.944185 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:17.944200 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:17.946140 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:17.948983 (+ 2843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.948988 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.948991 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.949443 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.949844 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:17.949849 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:17.949852 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:17.950045 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:17.950614 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:17.950617 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:17.950734 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 07:03:17.950853 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 07:03:17.951045 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":21}
I20260812 07:03:17.951588 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:17.939711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42734 (local address 127.18.70.188:46237)
0812 07:03:17.939850 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:17.939854 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:17.939866 (+ 12us) server_negotiation.cc:407] Connection header received
0812 07:03:17.939897 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:17.939900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:17.939946 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:17.940019 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:17.940767 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.941640 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.942793 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:17.943403 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:17.943546 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:17.946299 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:17.946303 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:17.946307 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:17.946333 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:17.948863 (+ 2530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.949561 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.949566 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.949569 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.949727 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:17.950192 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:17.950198 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:17.950201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:17.950501 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:17.950638 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:17.950992 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 07:03:17.951229 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":50}
I20260812 07:03:17.954927 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:03:17.956678 28512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde: Bootstrap starting.
I20260812 07:03:17.960633 28512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:17.957667 28147 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45720
I20260812 07:03:17.961946 28512 log.cc:824] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:17.964771 28512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde: No bootstrap required, opened a new log
I20260812 07:03:17.975284 28512 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } }
I20260812 07:03:17.975653 28512 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ffcf84120b4cd59a79ff713daf0dde, State: Initialized, Role: FOLLOWER
I20260812 07:03:17.976125 28512 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } }
I20260812 07:03:17.976984 28523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } } }
I20260812 07:03:17.977286 28523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:17.978168 28512 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [sys.catalog]: configured and running, proceeding with master startup.
W20260812 07:03:17.987437 28556 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 07:03:17.987553 28556 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 07:03:17.985105 28356 master_runner.cc:186] Error getting master registration for 127.18.70.190:46353: OK, instance_id { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" instance_seqno: 1786518196895509 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 07:03:17.992988 28356 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 07:03:18.026571 28206 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } attempt: 4
Aug 12 07:03:18 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518196, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
I20260812 07:03:18.040151 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:18.027250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42748)
0812 07:03:18.027442 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:18.027462 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:18.027571 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:18.027882 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:18.027886 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:18.028270 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:18.028464 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:18.028475 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.029961 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.029968 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:18.030929 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:18.030943 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.031688 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.031693 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:18.031900 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:18.032472 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:18.032496 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:18.034595 (+ 2099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:18.037645 (+ 3050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:18.037651 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:18.037655 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:18.038087 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:18.038447 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:18.038451 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:18.038454 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:18.038588 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:18.039198 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:18.039203 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:18.039361 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 07:03:18.039476 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 07:03:18.039742 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 07:03:18.040169 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:18.027342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42748 (local address 127.18.70.188:46237)
0812 07:03:18.027557 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.027563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.027587 (+ 24us) server_negotiation.cc:407] Connection header received
0812 07:03:18.027662 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.027668 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.027747 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.027871 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.028594 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.029772 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.031080 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.031542 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.031651 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:18.034769 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:18.034774 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:18.034777 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:18.034811 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:18.037522 (+ 2711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:18.038197 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:18.038203 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:18.038206 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:18.038326 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:18.038703 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:18.038707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:18.038709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:18.039076 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:18.039235 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:18.039626 (+ 391us) server_negotiation.cc:299] Negotiation successful
0812 07:03:18.039822 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 07:03:18.044653 28206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9: Bootstrap starting.
I20260812 07:03:18.048640 28206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:18.049932 28206 log.cc:824] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:18.053333 28206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9: No bootstrap required, opened a new log
I20260812 07:03:18.060883 28206 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } }
I20260812 07:03:18.061280 28206 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ea609ab560d4dcea18c9a26d6a60dd9, State: Initialized, Role: FOLLOWER
I20260812 07:03:18.061782 28206 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } }
I20260812 07:03:18.062724 28561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } } }
I20260812 07:03:18.063119 28561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:18.063927 28206 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:18.063992 28147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 07:03:18.064177 28147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:18.066915 28147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } }
I20260812 07:03:18.068120 28147 leader_election.cc:288] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [CANDIDATE]: Term 1 election: Requested vote from peers c422ea7acf2045eebb3db8a9d85e3eca (127.18.70.189:42913), 89ffcf84120b4cd59a79ff713daf0dde (127.18.70.188:46237)
I20260812 07:03:18.069002 28454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "89ffcf84120b4cd59a79ff713daf0dde"
I20260812 07:03:18.069409 28454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:18.072153 28454 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ea609ab560d4dcea18c9a26d6a60dd9 in term 1.
I20260812 07:03:18.072732 28106 leader_election.cc:302] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ea609ab560d4dcea18c9a26d6a60dd9, 89ffcf84120b4cd59a79ff713daf0dde; no voters:
I20260812 07:03:18.074144 28561 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:03:18.075489 28561 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [term 1 LEADER]: Becoming Leader. State: Replica: 1ea609ab560d4dcea18c9a26d6a60dd9, State: Running, Role: LEADER
I20260812 07:03:18.076037 28561 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } }
I20260812 07:03:18.079501 28577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ea609ab560d4dcea18c9a26d6a60dd9. Latest consensus state: current_term: 1 leader_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } } }
I20260812 07:03:18.079921 28577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [sys.catalog]: This master's current role is: LEADER
W20260812 07:03:18.101109 28595 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 07:03:18.101274 28595 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 07:03:18.101460 28588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:03:18.103690 28588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:03:18.108505 28348 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } attempt: 5
I20260812 07:03:18.097100 28070 master_runner.cc:186] Error getting master registration for 127.18.70.189:42913: OK, instance_id { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" instance_seqno: 1786518197386712 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
Aug 12 07:03:18 dist-test-slave-tc2s krb5kdc[28043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518197, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
I20260812 07:03:18.122628 28070 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 07:03:18.126375 28403 tablet.cc:2369] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:03:18.129477 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:18.110165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42762 (local address 127.18.70.188:46237)
0812 07:03:18.110328 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.110334 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.110363 (+ 29us) server_negotiation.cc:407] Connection header received
0812 07:03:18.110425 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.110431 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.110516 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.110617 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.111773 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.112888 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.114854 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.115633 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.115759 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:18.120087 (+ 4328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:18.120096 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:18.120102 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:18.120145 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:18.124253 (+ 4108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:18.125517 (+ 1264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:18.125524 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:18.125564 (+ 40us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:18.125867 (+ 303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:18.126663 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:18.126669 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:18.126673 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:18.127319 (+ 646us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:18.127558 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:18.128428 (+ 870us) server_negotiation.cc:299] Negotiation successful
0812 07:03:18.128873 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 07:03:18.131119 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:18.109130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:46237 (local address 127.0.0.1:42762)
0812 07:03:18.109552 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:18.109574 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:18.109697 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:18.110828 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:18.110834 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:18.111363 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:18.111581 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:18.111595 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.113074 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.113081 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:18.114633 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:18.114651 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.115992 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.116000 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:18.116254 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:18.116920 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:18.116946 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:18.119863 (+ 2917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:18.124386 (+ 4523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:18.124484 (+ 98us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:18.124490 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:18.125336 (+ 846us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:18.126128 (+ 792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:18.126134 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:18.126138 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:18.126407 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:18.127705 (+ 1298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:18.127711 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:18.127981 (+ 270us) client_negotiation.cc:769] Sending connection context
0812 07:03:18.129966 (+ 1985us) client_negotiation.cc:240] Negotiation successful
0812 07:03:18.130548 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279}
I20260812 07:03:18.133349 28453 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [term 1 FOLLOWER]: Refusing update from remote peer 1ea609ab560d4dcea18c9a26d6a60dd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260812 07:03:18.135886 28111 tablet.cc:2369] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:03:18.137738 28348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca: Bootstrap starting.
I20260812 07:03:18.138345 28561 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:03:18.143362 28348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:18.144667 28348 log.cc:824] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:18.165709 28523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ea609ab560d4dcea18c9a26d6a60dd9. Latest consensus state: current_term: 1 leader_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } } }
I20260812 07:03:18.166059 28523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:18.167615 28348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca: No bootstrap required, opened a new log
I20260812 07:03:18.169220 28520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:18.131022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45732 (local address 127.18.70.190:46353)
0812 07:03:18.131213 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.131220 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.142431 (+ 11211us) server_negotiation.cc:407] Connection header received
0812 07:03:18.142754 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.142759 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.142840 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.142910 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.145133 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.146255 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.148210 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.148892 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.149004 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:18.162083 (+ 13079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:18.162090 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:18.162095 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:18.162141 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:18.165952 (+ 3811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:18.166753 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:18.166759 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:18.166763 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:18.166928 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:18.167397 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:18.167403 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:18.167406 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:18.167774 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:18.168009 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:18.168624 (+ 615us) server_negotiation.cc:299] Negotiation successful
0812 07:03:18.168849 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 07:03:18.190739 28577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } } }
I20260812 07:03:18.191017 28577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:18.192255 28521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:18.146479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34418 (local address 127.18.70.189:42913)
0812 07:03:18.146684 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.146690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.158085 (+ 11395us) server_negotiation.cc:407] Connection header received
0812 07:03:18.160297 (+ 2212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.160321 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.160415 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.160485 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.171575 (+ 11090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.172588 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.174863 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.175522 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.175626 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:18.181758 (+ 6132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:18.181764 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:18.181769 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:18.181808 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:18.185364 (+ 3556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:18.186463 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:18.186468 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:18.186472 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:18.186632 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:18.190381 (+ 3749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:18.190387 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:18.190391 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:18.190797 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:18.191072 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:18.191649 (+ 577us) server_negotiation.cc:299] Negotiation successful
0812 07:03:18.191881 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 07:03:18.193415 28348 raft_consensus.cc:348] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } }
I20260812 07:03:18.193838 28348 raft_consensus.cc:729] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c422ea7acf2045eebb3db8a9d85e3eca, State: Initialized, Role: FOLLOWER
I20260812 07:03:18.194410 28348 consensus_queue.cc:260] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } }
I20260812 07:03:18.197237 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:18.158609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42774 (local address 127.18.70.188:46237)
0812 07:03:18.158787 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.158793 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.171874 (+ 13081us) server_negotiation.cc:407] Connection header received
0812 07:03:18.172051 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.172056 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.172146 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.172236 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.174113 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.175134 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.176883 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:18.177541 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:18.177640 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:18.190059 (+ 12419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:18.190066 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:18.190072 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:18.190113 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:18.193522 (+ 3409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:18.194658 (+ 1136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:18.194663 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:18.194666 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:18.194810 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:18.195320 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:18.195325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:18.195329 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:18.195726 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:18.196008 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:18.196549 (+ 541us) server_negotiation.cc:299] Negotiation successful
0812 07:03:18.196811 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 07:03:18.197961 28523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } } }
I20260812 07:03:18.198211 28523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:18.200522 28618 sys_catalog.cc:455] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } } }
I20260812 07:03:18.201035 28618 sys_catalog.cc:458] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:18.201498 28588 catalog_manager.cc:1347] Generated new cluster ID: c297af3dcb24496aa55292be8a25de1d
I20260812 07:03:18.201601 28588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:03:18.201946 28348 sys_catalog.cc:564] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:18.202286 28308 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:18.206182 28308 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [term 1 FOLLOWER]: Refusing update from remote peer 1ea609ab560d4dcea18c9a26d6a60dd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:03:18.207043 28577 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:03:18.208480 28309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c422ea7acf2045eebb3db8a9d85e3eca"
I20260812 07:03:18.228909 28588 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:03:18.230626 28588 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:03:18.244731 28309 raft_consensus.cc:2396] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ea609ab560d4dcea18c9a26d6a60dd9 for term 1 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260812 07:03:18.245396 28618 sys_catalog.cc:455] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ea609ab560d4dcea18c9a26d6a60dd9. Latest consensus state: current_term: 1 leader_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } } }
I20260812 07:03:18.245671 28618 sys_catalog.cc:458] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:18.245767 28561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } } }
I20260812 07:03:18.247184 28561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9 [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:18.249292 28629 sys_catalog.cc:455] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ea609ab560d4dcea18c9a26d6a60dd9" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 46353 } } peers { permanent_uuid: "c422ea7acf2045eebb3db8a9d85e3eca" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 42913 } } peers { permanent_uuid: "89ffcf84120b4cd59a79ff713daf0dde" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 46237 } } }
I20260812 07:03:18.249747 28629 sys_catalog.cc:458] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:18.254603 28653 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 07:03:18.261266 28588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ea609ab560d4dcea18c9a26d6a60dd9: Generated new TSK 0
I20260812 07:03:18.262039 28588 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 07:03:18.352185 28520 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.337922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45748 (local address 127.18.70.190:46353)
0812 07:03:18.338302 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.338309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.349929 (+ 11620us) server_negotiation.cc:407] Connection header received
0812 07:03:18.350441 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.350448 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.350540 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.350624 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.351912 (+ 1288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45748: BlockingRecv error: recv got EOF from 127.0.0.1:45748 (error 108)
Metrics: {"server-negotiator.queue_time_us":226}
W20260812 07:03:18.354642 28518 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.351626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42784 (local address 127.18.70.188:46237)
0812 07:03:18.351812 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.351818 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.353138 (+ 1320us) server_negotiation.cc:407] Connection header received
0812 07:03:18.353378 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.353384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.353465 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.353536 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.354407 (+ 871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42784: BlockingRecv error: recv got EOF from 127.0.0.1:42784 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260812 07:03:18.354969 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.338060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34434 (local address 127.18.70.189:42913)
0812 07:03:18.338463 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.338469 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.351000 (+ 12531us) server_negotiation.cc:407] Connection header received
0812 07:03:18.352542 (+ 1542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.352548 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.352640 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.352716 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.354704 (+ 1988us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34434: BlockingRecv error: recv got EOF from 127.0.0.1:34434 (error 108)
Metrics: {"server-negotiator.queue_time_us":276}
W20260812 07:03:18.362447 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.360384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34438 (local address 127.18.70.189:42913)
0812 07:03:18.360548 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.360553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.361020 (+ 467us) server_negotiation.cc:407] Connection header received
0812 07:03:18.361224 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.361230 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.361357 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.361458 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.362250 (+ 792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34438: BlockingRecv error: recv got EOF from 127.0.0.1:34438 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 07:03:18.373706 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.371772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34440 (local address 127.18.70.189:42913)
0812 07:03:18.371932 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.371938 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.372395 (+ 457us) server_negotiation.cc:407] Connection header received
0812 07:03:18.372573 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.372578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.372657 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.372753 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.373497 (+ 744us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34440: BlockingRecv error: recv got EOF from 127.0.0.1:34440 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260812 07:03:18.382055 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.380057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34450 (local address 127.18.70.189:42913)
0812 07:03:18.380200 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.380206 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.380739 (+ 533us) server_negotiation.cc:407] Connection header received
0812 07:03:18.380890 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.380895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.380973 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.381079 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.381802 (+ 723us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34450: BlockingRecv error: recv got EOF from 127.0.0.1:34450 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260812 07:03:18.392149 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.390113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34454 (local address 127.18.70.189:42913)
0812 07:03:18.390291 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.390296 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.390740 (+ 444us) server_negotiation.cc:407] Connection header received
0812 07:03:18.390981 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.390986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.391065 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.391134 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.391935 (+ 801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34454: BlockingRecv error: recv got EOF from 127.0.0.1:34454 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260812 07:03:18.423734 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.421416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34460 (local address 127.18.70.189:42913)
0812 07:03:18.421609 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.421615 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.422169 (+ 554us) server_negotiation.cc:407] Connection header received
0812 07:03:18.422385 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.422390 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.422488 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.422610 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.423478 (+ 868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34460: BlockingRecv error: recv got EOF from 127.0.0.1:34460 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 07:03:18.449733 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.447497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34474 (local address 127.18.70.189:42913)
0812 07:03:18.447695 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.447702 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.448238 (+ 536us) server_negotiation.cc:407] Connection header received
0812 07:03:18.448462 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.448468 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.448558 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.448660 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.449482 (+ 822us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34474: BlockingRecv error: recv got EOF from 127.0.0.1:34474 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260812 07:03:18.487470 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.485481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34488 (local address 127.18.70.189:42913)
0812 07:03:18.485665 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.485672 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.486074 (+ 402us) server_negotiation.cc:407] Connection header received
0812 07:03:18.486274 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.486278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.486360 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.486448 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.487219 (+ 771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34488: BlockingRecv error: recv got EOF from 127.0.0.1:34488 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 07:03:18.556981 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.554917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34494 (local address 127.18.70.189:42913)
0812 07:03:18.555118 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.555124 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.555449 (+ 325us) server_negotiation.cc:407] Connection header received
0812 07:03:18.555734 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.555741 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.555841 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.555974 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.556734 (+ 760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34494: BlockingRecv error: recv got EOF from 127.0.0.1:34494 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260812 07:03:18.689951 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.688113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34498 (local address 127.18.70.189:42913)
0812 07:03:18.688308 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.688315 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.688656 (+ 341us) server_negotiation.cc:407] Connection header received
0812 07:03:18.688825 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.688829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.688931 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.689030 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.689714 (+ 684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34498: BlockingRecv error: recv got EOF from 127.0.0.1:34498 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260812 07:03:18.951164 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:18.949328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34502 (local address 127.18.70.189:42913)
0812 07:03:18.949567 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:18.949574 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:18.949761 (+ 187us) server_negotiation.cc:407] Connection header received
0812 07:03:18.950041 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:18.950046 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:18.950124 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:18.950217 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:18.950971 (+ 754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34502: BlockingRecv error: recv got EOF from 127.0.0.1:34502 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 07:03:18.989554 28556 catalog_manager.cc:1259] Loaded cluster ID: c297af3dcb24496aa55292be8a25de1d
I20260812 07:03:18.989650 28556 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde: loading cluster ID for follower catalog manager: success
I20260812 07:03:18.992142 28556 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde: acquiring CA information for follower catalog manager: success
I20260812 07:03:18.993870 28556 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 89ffcf84120b4cd59a79ff713daf0dde: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 07:03:19.259146 28653 catalog_manager.cc:1259] Loaded cluster ID: c297af3dcb24496aa55292be8a25de1d
I20260812 07:03:19.259270 28653 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca: loading cluster ID for follower catalog manager: success
I20260812 07:03:19.262091 28653 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca: acquiring CA information for follower catalog manager: success
I20260812 07:03:19.263957 28653 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c422ea7acf2045eebb3db8a9d85e3eca: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 07:03:19.474444 28786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:19.467041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34510 (local address 127.18.70.189:42913)
0812 07:03:19.467638 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:19.467645 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:19.468036 (+ 391us) server_negotiation.cc:407] Connection header received
0812 07:03:19.468239 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:19.468243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:19.468404 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:19.468517 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:19.469006 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:19.469839 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:19.471964 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:19.472427 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:19.472520 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:19.473112 (+ 592us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:19.473706 (+ 594us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:19.473812 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:19.474003 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 07:03:19.474074 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":291,"threads_started":1}
I20260812 07:03:19.487322 28801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:19.481101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42792 (local address 127.18.70.188:46237)
0812 07:03:19.481764 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:19.481768 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:19.481784 (+ 16us) server_negotiation.cc:407] Connection header received
0812 07:03:19.481875 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:19.481880 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:19.482066 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:19.482195 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:19.482654 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:19.483357 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:19.485198 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:19.485608 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:19.485694 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:19.486244 (+ 550us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:19.486721 (+ 477us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:19.486820 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:19.486966 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 07:03:19.487032 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":472,"threads_started":1}
I20260812 07:03:19.508684 28786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:19.493619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34518 (local address 127.18.70.189:42913)
0812 07:03:19.493799 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:19.493805 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:19.501004 (+ 7199us) server_negotiation.cc:407] Connection header received
0812 07:03:19.501094 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:19.501098 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:19.501182 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:19.501287 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:19.502696 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:19.503885 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:19.506227 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:19.506947 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:19.507049 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:19.507773 (+ 724us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:19.507924 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:19.508010 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:19.508252 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 07:03:19.508344 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 07:03:19.509912 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:19.493275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45754 (local address 127.18.70.190:46353)
0812 07:03:19.501097 (+ 7822us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:19.501104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:19.501125 (+ 21us) server_negotiation.cc:407] Connection header received
0812 07:03:19.501245 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:19.501251 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:19.501475 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:19.501962 (+ 487us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:19.502568 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:19.503793 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:19.506185 (+ 2392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:19.506856 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:19.507488 (+ 632us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:19.507706 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:19.508219 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:19.509065 (+ 846us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:19.509115 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 07:03:19.509200 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7689,"thread_start_us":7595,"threads_started":1}
I20260812 07:03:19.514249 28801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:19.500826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42808 (local address 127.18.70.188:46237)
0812 07:03:19.500977 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:19.500981 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:19.508864 (+ 7883us) server_negotiation.cc:407] Connection header received
0812 07:03:19.509059 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:19.509065 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:19.509161 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:19.509248 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:19.509606 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:19.510549 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:19.512197 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:19.512681 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:19.512788 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:19.513508 (+ 720us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:19.513604 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:19.513674 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:19.513886 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 07:03:19.513986 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 07:03:19.516428 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 28070
I20260812 07:03:19.517518 28192 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:03:19.628624 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 28070
I20260812 07:03:19.659546 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 28216
I20260812 07:03:19.660610 28343 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:03:19.764482 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 28216
I20260812 07:03:19.790316 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 28356
I20260812 07:03:19.791438 28503 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:03:19.896986 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 28356
2026-08-12T07:03:19Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4957 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 07:03:20 dist-test-slave-tc2s krb5kdc[28832](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 07:03:20 dist-test-slave-tc2s krb5kdc[28832](info): set up 2 sockets
Aug 12 07:03:20 dist-test-slave-tc2s krb5kdc[28832](info): commencing operation
krb5kdc: starting...
W20260812 07:03:21.185642 18714 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/test-user.keytab.
Aug 12 07:03:21 dist-test-slave-tc2s krb5kdc[28832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T07:03:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T07:03:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.70.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
Entry for principal kudu/127.18.70.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab.
I20260812 07:03:21.477507 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43477
--webserver_interface=127.18.70.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:46431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:43477,127.18.70.189:38227,127.18.70.188:33305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 07:03:21.805513 28855 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 07:03:21.805791 28855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:21.805859 28855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:21.805979 28855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:21.812829 28855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:21.812903 28855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:21.812964 28855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:21.813011 28855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:21.813072 28855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:21.822374 28855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:43477,127.18.70.189:38227,127.18.70.188:33305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.190.keytab
--principal=kudu/127.18.70.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.190:43477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.70.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:21.823483 28855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:21.824649 28855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:21.835693 28869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:21.835713 28871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:21.836410 28868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:21.836421 28855 server_base.cc:1034] running on GCE node
I20260812 07:03:21.837198 28855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:21.838538 28855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:21.839787 28855 hybrid_clock.cc:648] HybridClock initialized: now 1786518201839717 us; error 31 us; skew 500 ppm
I20260812 07:03:21.840085 28855 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:21 dist-test-slave-tc2s krb5kdc[28832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518201, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:21.843130 28855 init.cc:377] Logged in from keytab as kudu/127.18.70.190@KRBTEST.COM (short username kudu)
I20260812 07:03:21.844472 28855 webserver.cc:460] Webserver started at http://127.18.70.190:42741/ using document root <none> and password file <none>
I20260812 07:03:21.845098 28855 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:21.845198 28855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:21.845510 28855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:21.848459 28855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/data/instance:
uuid: "a41f7a38626242028d62738c255e659c"
format_stamp: "Formatted at 2026-08-12 07:03:21 on dist-test-slave-tc2s"
server_key: "b91b0578a2ec400ac09416e2cc48b928"
server_key_iv: "63d5408e660ada61ec1ecd366a1b1859"
server_key_version: "encryptionkey@0"
I20260812 07:03:21.849213 28855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/wal/instance:
uuid: "a41f7a38626242028d62738c255e659c"
format_stamp: "Formatted at 2026-08-12 07:03:21 on dist-test-slave-tc2s"
server_key: "b91b0578a2ec400ac09416e2cc48b928"
server_key_iv: "63d5408e660ada61ec1ecd366a1b1859"
server_key_version: "encryptionkey@0"
I20260812 07:03:21.854228 28855 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 07:03:21.857468 28886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:21.858691 28855 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:03:21.858852 28855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/wal
uuid: "a41f7a38626242028d62738c255e659c"
format_stamp: "Formatted at 2026-08-12 07:03:21 on dist-test-slave-tc2s"
server_key: "b91b0578a2ec400ac09416e2cc48b928"
server_key_iv: "63d5408e660ada61ec1ecd366a1b1859"
server_key_version: "encryptionkey@0"
I20260812 07:03:21.859052 28855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:21.873595 28855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:21.877381 28855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:21.877619 28855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:21.894793 28855 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.190:43477
I20260812 07:03:21.894814 28983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.190:43477 every 8 connection(s)
I20260812 07:03:21.896090 28855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/data/info.pb
I20260812 07:03:21.899709 28985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:21.904764 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 28855
I20260812 07:03:21.904956 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-0/wal/instance
I20260812 07:03:21.905413 18714 external_mini_cluster.cc:1428] Setting key 93312f5288c66a20eabe3cc8e6629302
I20260812 07:03:21.906400 28985 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:03:21 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518201, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:03:21.928608 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:21.909446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43477 (local address 127.0.0.1:33576)
0812 07:03:21.910376 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:21.910430 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:21.912302 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:21.913160 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:21.913165 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:21.913684 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:21.914063 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:21.914082 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:21.916072 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:21.916077 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:21.917171 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:21.917183 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:21.918285 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:21.918290 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:21.918489 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:21.919086 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:21.919107 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:21.921299 (+ 2192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:21.924913 (+ 3614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:21.924923 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:21.924932 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:21.925302 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:21.925762 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:21.925765 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:21.925767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:21.925970 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:21.926780 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:21.926786 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:21.926982 (+ 196us) client_negotiation.cc:769] Sending connection context
0812 07:03:21.927182 (+ 200us) client_negotiation.cc:240] Negotiation successful
0812 07:03:21.927557 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"mutex_wait_us":52,"thread_start_us":406,"threads_started":1}
I20260812 07:03:21.928664 28992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:21.909445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33576 (local address 127.18.70.190:43477)
0812 07:03:21.911050 (+ 1605us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:21.911058 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:21.911114 (+ 56us) server_negotiation.cc:407] Connection header received
0812 07:03:21.912659 (+ 1545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:21.912666 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:21.912946 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:21.913136 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:21.914269 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:21.915924 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:21.917312 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:21.918078 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:21.918247 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:21.921538 (+ 3291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:21.921548 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:21.921563 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:21.921596 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:21.924787 (+ 3191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:21.925461 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:21.925470 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:21.925473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:21.925663 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:21.926066 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:21.926070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:21.926073 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:21.926647 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:21.926837 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:21.927389 (+ 552us) server_negotiation.cc:299] Negotiation successful
0812 07:03:21.927683 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":97,"server-negotiator.queue_time_us":1409,"spinlock_wait_cycles":43392,"thread_start_us":1203,"threads_started":1}
I20260812 07:03:21.931326 28985 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } has no permanent_uuid. Determining permanent_uuid...
I20260812 07:03:21.932464 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:21.932057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49050)
0812 07:03:21.932227 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:21.932346 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260812 07:03:21.932732 28889 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
I20260812 07:03:21.934269 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:21.933871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49060)
0812 07:03:21.934036 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:21.934112 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260812 07:03:21.934480 28985 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:38227: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.18.70.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab.
Entry for principal kudu/127.18.70.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab.
I20260812 07:03:21.974795 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.189:38227
--webserver_interface=127.18.70.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab
--principal=kudu/127.18.70.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:46431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:43477,127.18.70.189:38227,127.18.70.188:33305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:03:21.983791 28985 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } attempt: 1
I20260812 07:03:21.985014 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:21.984519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49064)
0812 07:03:21.984720 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:21.984857 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 07:03:21.986128 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:21.985661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49076)
0812 07:03:21.985813 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:21.985934 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 07:03:21.986352 28985 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:38227: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
I20260812 07:03:22.054610 28985 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } attempt: 2
I20260812 07:03:22.055928 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.055367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49086)
0812 07:03:22.055599 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.055721 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260812 07:03:22.057018 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.056548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49094)
0812 07:03:22.056715 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.056827 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 07:03:22.057260 28985 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:38227: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
I20260812 07:03:22.148535 28985 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } attempt: 3
I20260812 07:03:22.149809 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.149276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49110)
0812 07:03:22.149505 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.149628 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 07:03:22.150861 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.150435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49120)
0812 07:03:22.150602 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.150695 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 07:03:22.151090 28985 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:38227: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
I20260812 07:03:22.294341 28985 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } attempt: 4
I20260812 07:03:22.295578 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.294939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49136)
0812 07:03:22.295277 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.295391 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167}
I20260812 07:03:22.296625 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.296215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49144)
0812 07:03:22.296380 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.296482 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 07:03:22.296917 28985 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.189:38227: Network error: Client connection negotiation failed: client connection to 127.18.70.189:38227: connect: Connection refused (error 111)
W20260812 07:03:22.304282 28999 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 07:03:22.304580 28999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:22.304673 28999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:22.304780 28999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 07:03:22.311983 28999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:22.312080 28999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:22.312199 28999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:22.312278 28999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:22.312372 28999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:22.321722 28999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:43477,127.18.70.189:38227,127.18.70.188:33305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.189.keytab
--principal=kudu/127.18.70.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.189:38227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.70.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:22.322866 28999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:22.324113 28999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:22.335037 29005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:22.335068 29010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:22.335100 29006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:22.335968 28999 server_base.cc:1034] running on GCE node
I20260812 07:03:22.336696 28999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:22.337926 28999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:22.339136 28999 hybrid_clock.cc:648] HybridClock initialized: now 1786518202339071 us; error 48 us; skew 500 ppm
I20260812 07:03:22.339430 28999 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:22 dist-test-slave-tc2s krb5kdc[28832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518202, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:22.342350 28999 init.cc:377] Logged in from keytab as kudu/127.18.70.189@KRBTEST.COM (short username kudu)
I20260812 07:03:22.343642 28999 webserver.cc:460] Webserver started at http://127.18.70.189:43277/ using document root <none> and password file <none>
I20260812 07:03:22.344259 28999 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:22.344360 28999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:22.344666 28999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:22.347471 28999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/data/instance:
uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac"
format_stamp: "Formatted at 2026-08-12 07:03:22 on dist-test-slave-tc2s"
server_key: "fddd06c1f0eaac88cf9d5373979d7b03"
server_key_iv: "1be42c883965c733f5099394e27fdf45"
server_key_version: "encryptionkey@0"
I20260812 07:03:22.348261 28999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/wal/instance:
uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac"
format_stamp: "Formatted at 2026-08-12 07:03:22 on dist-test-slave-tc2s"
server_key: "fddd06c1f0eaac88cf9d5373979d7b03"
server_key_iv: "1be42c883965c733f5099394e27fdf45"
server_key_version: "encryptionkey@0"
I20260812 07:03:22.353003 28999 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 07:03:22.356247 29024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:22.357463 28999 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 07:03:22.357625 28999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/wal
uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac"
format_stamp: "Formatted at 2026-08-12 07:03:22 on dist-test-slave-tc2s"
server_key: "fddd06c1f0eaac88cf9d5373979d7b03"
server_key_iv: "1be42c883965c733f5099394e27fdf45"
server_key_version: "encryptionkey@0"
I20260812 07:03:22.357815 28999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:22.371913 28999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:22.375568 28999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:22.375797 28999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:22.392232 28999 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.189:38227
I20260812 07:03:22.392251 29116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.189:38227 every 8 connection(s)
I20260812 07:03:22.393430 28999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/data/info.pb
I20260812 07:03:22.396725 29121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:22.402230 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 28999
I20260812 07:03:22.402408 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-1/wal/instance
I20260812 07:03:22.402804 18714 external_mini_cluster.cc:1428] Setting key d7f72cebdac086a2e5b77959bdb75129
I20260812 07:03:22.402767 29121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:03:22 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518202, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:03:22.421166 28992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.405152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33588 (local address 127.18.70.190:43477)
0812 07:03:22.405320 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:22.405326 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:22.406495 (+ 1169us) server_negotiation.cc:407] Connection header received
0812 07:03:22.408235 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:22.408240 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:22.408319 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:22.408409 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:22.409779 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.410503 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.411924 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.412362 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.412472 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.415620 (+ 3148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:22.415624 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:22.415628 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:22.415662 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:22.418234 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.419045 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.419048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.419051 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.419175 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.419578 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.419581 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.419583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.419871 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:22.419983 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:22.420753 (+ 770us) server_negotiation.cc:299] Negotiation successful
0812 07:03:22.420934 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 07:03:22.422277 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.405614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43477 (local address 127.0.0.1:33588)
0812 07:03:22.406341 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.406382 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:22.407982 (+ 1600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:22.408632 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:22.408639 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:22.409114 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:22.409608 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.409624 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.410653 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.410657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.411784 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.411796 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.412569 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.412576 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.412788 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.413357 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:22.413384 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:22.415416 (+ 2032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:22.418372 (+ 2956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.418380 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.418392 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.418947 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.419270 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.419274 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.419277 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.419483 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.420004 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:22.420011 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:22.420402 (+ 391us) client_negotiation.cc:769] Sending connection context
0812 07:03:22.420669 (+ 267us) client_negotiation.cc:240] Negotiation successful
0812 07:03:22.421088 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":340,"threads_started":1}
I20260812 07:03:22.423918 29121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:03:22 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518202, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.70.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.70.188@KRBTEST.COM" created.
I20260812 07:03:22.438758 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.424631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49146)
0812 07:03:22.424800 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.424817 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:22.424917 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:22.425946 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:22.425951 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:22.426289 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:22.426439 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.426448 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.428159 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.428163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.429000 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.429011 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.430077 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.430082 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.430202 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.430749 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:22.430768 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:22.432905 (+ 2137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:22.436347 (+ 3442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.436351 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.436353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.436799 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.437116 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.437120 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.437123 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.437281 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.437874 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:22.437878 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:22.438027 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 07:03:22.438149 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 07:03:22.438416 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 07:03:22.438791 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.424791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49146 (local address 127.18.70.189:38227)
0812 07:03:22.425491 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:22.425500 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:22.425531 (+ 31us) server_negotiation.cc:407] Connection header received
0812 07:03:22.425579 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:22.425586 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:22.425769 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:22.425936 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:22.426619 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.428022 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.429142 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.429951 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.430057 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.433123 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:22.433137 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:22.433152 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:22.433196 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:22.436216 (+ 3020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.436909 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.436915 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.436917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.437030 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.437372 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.437375 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.437377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.437710 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:22.437943 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:22.438323 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 07:03:22.438498 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":363,"threads_started":1}
I20260812 07:03:22.441253 29121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } has no permanent_uuid. Determining permanent_uuid...
I20260812 07:03:22.442395 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.441978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:51314)
0812 07:03:22.442137 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.442250 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 07:03:22.442698 29030 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
I20260812 07:03:22.444118 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.443823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:51316)
0812 07:03:22.443940 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.444018 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 07:03:22.444377 29121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:33305: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.70.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab.
Entry for principal kudu/127.18.70.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab.
I20260812 07:03:22.470943 18714 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
/tmp/dist-test-taskGv53JZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.188:33305
--webserver_interface=127.18.70.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab
--principal=kudu/127.18.70.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.70.148:46431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.70.190:43477,127.18.70.189:38227,127.18.70.188:33305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 07:03:22.493674 29121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } attempt: 1
I20260812 07:03:22.494773 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.494337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:51326)
0812 07:03:22.494527 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.494625 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 07:03:22.495769 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.495468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:51328)
0812 07:03:22.495581 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.495667 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260812 07:03:22.495978 29121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:33305: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
I20260812 07:03:22.564175 29121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } attempt: 2
I20260812 07:03:22.565272 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.564831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:51330)
0812 07:03:22.565020 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.565111 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 07:03:22.566203 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.565877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:51340)
0812 07:03:22.566015 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.566085 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260812 07:03:22.566416 29121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:33305: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
I20260812 07:03:22.596176 28985 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } attempt: 5
Aug 12 07:03:22 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518201, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
I20260812 07:03:22.610241 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.596874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49150 (local address 127.18.70.189:38227)
0812 07:03:22.597026 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:22.597030 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:22.597074 (+ 44us) server_negotiation.cc:407] Connection header received
0812 07:03:22.597303 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:22.597307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:22.597410 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:22.597488 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:22.598553 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.599319 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.601060 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.601496 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.601589 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.604992 (+ 3403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:22.604996 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:22.604999 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:22.605031 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:22.607536 (+ 2505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.608392 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.608397 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.608399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.608528 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.608928 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.608931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.608934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.609212 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:22.609360 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:22.609799 (+ 439us) server_negotiation.cc:299] Negotiation successful
0812 07:03:22.610030 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 07:03:22.610368 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.596764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:49150)
0812 07:03:22.596991 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.597012 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:22.597167 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:22.597562 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:22.597567 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:22.598159 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:22.598407 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.598423 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.599471 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.599477 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.600882 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.600909 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.601646 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.601653 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.601865 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.602502 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:22.602523 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:22.604804 (+ 2281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:22.607703 (+ 2899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.607709 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.607713 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.608219 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.608638 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.608643 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.608646 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.608818 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.609329 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:22.609335 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:22.609514 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 07:03:22.609712 (+ 198us) client_negotiation.cc:240] Negotiation successful
0812 07:03:22.610029 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 07:03:22.611413 28985 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } has no permanent_uuid. Determining permanent_uuid...
I20260812 07:03:22.612401 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.612051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:51342)
0812 07:03:22.612192 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.612263 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 07:03:22.613271 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.612956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:51348)
0812 07:03:22.613095 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.613173 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 07:03:22.613463 28985 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:33305: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
I20260812 07:03:22.657612 29121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } attempt: 3
I20260812 07:03:22.658828 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.658358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:43950)
0812 07:03:22.658559 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.658657 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 07:03:22.659843 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.659416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:43958)
0812 07:03:22.659637 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.659713 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260812 07:03:22.660063 29121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:33305: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
I20260812 07:03:22.664655 28985 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } attempt: 1
I20260812 07:03:22.665552 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.665151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:43964)
0812 07:03:22.665317 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.665400 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 07:03:22.666522 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.666217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:43976)
0812 07:03:22.666363 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.666429 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 07:03:22.666728 28985 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:33305: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
I20260812 07:03:22.734941 28985 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } attempt: 2
I20260812 07:03:22.736042 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.735554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:43992)
0812 07:03:22.735781 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.735870 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 07:03:22.737064 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.736726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:44000)
0812 07:03:22.736878 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.736948 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 07:03:22.737269 28985 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:33305: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
W20260812 07:03:22.796746 29136 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 07:03:22.797055 29136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 07:03:22.797153 29136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 07:03:22.797271 29136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 07:03:22.803270 29121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } attempt: 4
I20260812 07:03:22.804316 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.803840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:44016)
0812 07:03:22.804082 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.804165 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260812 07:03:22.804323 29136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 07:03:22.804412 29136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 07:03:22.804513 29136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 07:03:22.804579 29136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 07:03:22.804667 29136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 07:03:22.805321 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.805014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:44028)
0812 07:03:22.805143 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.805215 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 07:03:22.805583 29121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:33305: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
I20260812 07:03:22.814257 29136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.70.148:46431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.70.190:43477,127.18.70.189:38227,127.18.70.188:33305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/krb5kdc/kudu_127.18.70.188.keytab
--principal=kudu/127.18.70.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.70.188:33305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.70.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 05:55:59 UTC on ccycloud.quasar-tbxajw.root.comops.site
build id 4581995
ASAN enabled
I20260812 07:03:22.815376 29136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 07:03:22.816581 29136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 07:03:22.827831 29150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:22.827782 29145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 07:03:22.827859 29155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 07:03:22.828562 29136 server_base.cc:1034] running on GCE node
I20260812 07:03:22.829233 29136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 07:03:22.830519 29136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 07:03:22.831736 29136 hybrid_clock.cc:648] HybridClock initialized: now 1786518202831677 us; error 31 us; skew 500 ppm
I20260812 07:03:22.832036 29136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 07:03:22 dist-test-slave-tc2s krb5kdc[28832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518202, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 07:03:22.835150 29136 init.cc:377] Logged in from keytab as kudu/127.18.70.188@KRBTEST.COM (short username kudu)
I20260812 07:03:22.836556 29136 webserver.cc:460] Webserver started at http://127.18.70.188:35945/ using document root <none> and password file <none>
I20260812 07:03:22.837179 29136 fs_manager.cc:359] Metadata directory not provided
I20260812 07:03:22.837280 29136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 07:03:22.837584 29136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 07:03:22.840397 29136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/data/instance:
uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c"
format_stamp: "Formatted at 2026-08-12 07:03:22 on dist-test-slave-tc2s"
server_key: "973391f20a381f603d66f2d25ac825b7"
server_key_iv: "54217a2a4a3af9e0389743d96934011e"
server_key_version: "encryptionkey@0"
I20260812 07:03:22.841151 29136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/wal/instance:
uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c"
format_stamp: "Formatted at 2026-08-12 07:03:22 on dist-test-slave-tc2s"
server_key: "973391f20a381f603d66f2d25ac825b7"
server_key_iv: "54217a2a4a3af9e0389743d96934011e"
server_key_version: "encryptionkey@0"
I20260812 07:03:22.843459 28985 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } attempt: 3
I20260812 07:03:22.844412 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.843973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:44044)
0812 07:03:22.844160 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.844239 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 07:03:22.845618 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.845168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:44054)
0812 07:03:22.845387 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.845487 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260812 07:03:22.845839 28985 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.70.188:33305: Network error: Client connection negotiation failed: client connection to 127.18.70.188:33305: connect: Connection refused (error 111)
I20260812 07:03:22.846552 29136 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 07:03:22.849810 29171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 07:03:22.851063 29136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 07:03:22.851219 29136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/data,/tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/wal
uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c"
format_stamp: "Formatted at 2026-08-12 07:03:22 on dist-test-slave-tc2s"
server_key: "973391f20a381f603d66f2d25ac825b7"
server_key_iv: "54217a2a4a3af9e0389743d96934011e"
server_key_version: "encryptionkey@0"
I20260812 07:03:22.851413 29136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 07:03:22.874797 29136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 07:03:22.878746 29136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 07:03:22.878980 29136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 07:03:22.896040 29136 rpc_server.cc:307] RPC server started. Bound to: 127.18.70.188:33305
I20260812 07:03:22.896080 29266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.70.188:33305 every 8 connection(s)
I20260812 07:03:22.897262 29136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/data/info.pb
I20260812 07:03:22.900825 29267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 07:03:22.904681 18714 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu as pid 29136
I20260812 07:03:22.904850 18714 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGv53JZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786517832212618-18714-0/minicluster-data/master-2/wal/instance
I20260812 07:03:22.905261 18714 external_mini_cluster.cc:1428] Setting key bd19bbd82012354a174cd8f870e20f9d
I20260812 07:03:22.907689 29267 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:03:22 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518202, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
Aug 12 07:03:22 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
I20260812 07:03:22.925855 28992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.911610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33020 (local address 127.18.70.190:43477)
0812 07:03:22.911760 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:22.911766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:22.912353 (+ 587us) server_negotiation.cc:407] Connection header received
0812 07:03:22.912547 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:22.912551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:22.912613 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:22.912681 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:22.914198 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.914889 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.916240 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.916688 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.916798 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.920012 (+ 3214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:22.920018 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:22.920021 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:22.920053 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:22.922632 (+ 2579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.923594 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.923598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.923600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.923733 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.924150 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.924154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.924156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.924417 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:22.924568 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:22.925253 (+ 685us) server_negotiation.cc:299] Negotiation successful
0812 07:03:22.925509 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 07:03:22.926765 29272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.911611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.190:43477 (local address 127.0.0.1:33020)
0812 07:03:22.912195 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.912233 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:22.912414 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:22.912771 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:22.912777 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:22.913620 (+ 843us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:22.914037 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.914058 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.915014 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.915018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.916107 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.916120 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.916921 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.916929 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.917094 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.917702 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:22.917722 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:22.919823 (+ 2101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:22.922763 (+ 2940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.922773 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.922783 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.923484 (+ 701us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.923859 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.923864 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.923868 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.924041 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.924549 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:22.924556 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:22.924884 (+ 328us) client_negotiation.cc:769] Sending connection context
0812 07:03:22.925153 (+ 269us) client_negotiation.cc:240] Negotiation successful
0812 07:03:22.925571 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"spinlock_wait_cycles":36224,"thread_start_us":240,"threads_started":1}
I20260812 07:03:22.926784 29270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.906961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44062 (local address 127.18.70.188:33305)
0812 07:03:22.907751 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:22.907765 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:22.907812 (+ 47us) server_negotiation.cc:407] Connection header received
0812 07:03:22.909705 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:22.909734 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:22.910214 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:22.910608 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:22.912137 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.914052 (+ 1915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.916107 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.916650 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.916809 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.920579 (+ 3770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:22.920591 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:22.920604 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:22.920641 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:22.923693 (+ 3052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.924291 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.924299 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.924301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.924427 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.924787 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.924791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.924794 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.925123 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:22.925407 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:22.925720 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 07:03:22.925969 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":320,"threads_started":1}
I20260812 07:03:22.928400 29267 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 07:03:22 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518202, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
Aug 12 07:03:22 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.190@KRBTEST.COM
I20260812 07:03:22.941735 29272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.929085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.189:38227 (local address 127.0.0.1:42614)
0812 07:03:22.929231 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.929249 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:22.929342 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:22.929970 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:22.929974 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:22.930354 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:22.930528 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.930540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.931733 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.931738 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.932764 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.932776 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.933671 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.933676 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.933879 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.934348 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:22.934370 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:22.936394 (+ 2024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:22.939489 (+ 3095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.939495 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.939498 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.939944 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.940297 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.940311 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.940315 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.940492 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.940984 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:22.940989 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:22.941154 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 07:03:22.941303 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 07:03:22.941515 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 07:03:22.942034 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.929100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42614 (local address 127.18.70.189:38227)
0812 07:03:22.929367 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:22.929372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:22.929391 (+ 19us) server_negotiation.cc:407] Connection header received
0812 07:03:22.929451 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:22.929457 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:22.929523 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:22.929624 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:22.930701 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.931606 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.932915 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.933553 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.933664 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.936573 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:22.936577 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:22.936581 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:22.936613 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:22.939365 (+ 2752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.940050 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.940054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.940057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.940193 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.940598 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.940601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.940603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.940857 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:22.940975 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:22.941427 (+ 452us) server_negotiation.cc:299] Negotiation successful
0812 07:03:22.941651 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260812 07:03:22.943022 29267 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } has no permanent_uuid. Determining permanent_uuid...
I20260812 07:03:22.943953 28992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.929568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33024 (local address 127.18.70.190:43477)
0812 07:03:22.929856 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:22.929861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:22.929877 (+ 16us) server_negotiation.cc:407] Connection header received
0812 07:03:22.929953 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:22.929957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:22.930020 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:22.930115 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:22.931340 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.932192 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.933617 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.934230 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.934357 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.938468 (+ 4111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:22.938472 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:22.938475 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:22.938504 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:22.941220 (+ 2716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.942062 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.942068 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.942071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.942227 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.942587 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.942591 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.942593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.942912 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:22.943165 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:22.943461 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 07:03:22.943659 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178}
Aug 12 07:03:22 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518202, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.188@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
Aug 12 07:03:22 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.70.189@KRBTEST.COM
I20260812 07:03:22.954952 29272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.943765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:44068)
0812 07:03:22.944160 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:22.944173 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:22.944263 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:22.944501 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:22.944505 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:22.944830 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:22.944955 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.944963 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.945957 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.945962 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.946775 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:22.946787 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.947432 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.947437 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:22.947634 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.948095 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:22.948111 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:22.950000 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:22.952620 (+ 2620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.952625 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.952629 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.953117 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.953480 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:22.953484 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:22.953486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:22.953612 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:22.954237 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:22.954240 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:22.954376 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 07:03:22.954484 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 07:03:22.954675 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297}
I20260812 07:03:22.955133 29270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.943774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44068 (local address 127.18.70.188:33305)
0812 07:03:22.943920 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:22.943925 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:22.944233 (+ 308us) server_negotiation.cc:407] Connection header received
0812 07:03:22.944343 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:22.944348 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:22.944404 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:22.944472 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:22.945080 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.945830 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.946902 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.947307 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.947411 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.950169 (+ 2758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:22.950173 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:22.950176 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:22.950210 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:22.952493 (+ 2283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.953225 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.953228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.953230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.953369 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.953756 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.953761 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.953764 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.954107 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:22.954251 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:22.954602 (+ 351us) server_negotiation.cc:299] Negotiation successful
0812 07:03:22.954819 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 07:03:22.958674 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:22.945363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42626 (local address 127.18.70.189:38227)
0812 07:03:22.945509 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:22.945514 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:22.945531 (+ 17us) server_negotiation.cc:407] Connection header received
0812 07:03:22.945602 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:22.945607 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:22.945667 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:22.945739 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:22.946952 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.947756 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.948894 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:22.949307 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:22.949417 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:22.953448 (+ 4031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:22.953454 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:22.953459 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:22.953493 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:22.956331 (+ 2838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.957069 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.957072 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.957075 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.957203 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:22.957570 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:22.957573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:22.957575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:22.957802 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:22.958046 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:22.958299 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 07:03:22.958455 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 07:03:22.960520 29267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c: Bootstrap starting.
I20260812 07:03:22.963047 18714 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 07:03:22.963948 29267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:22.964958 29267 log.cc:824] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:22.967639 29267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c: No bootstrap required, opened a new log
I20260812 07:03:22.965314 28934 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a41f7a38626242028d62738c255e659c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33024
I20260812 07:03:22.974413 29267 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } }
I20260812 07:03:22.974689 29267 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43fb50b7805643c6a9d3e3ea72f2bf9c, State: Initialized, Role: FOLLOWER
I20260812 07:03:22.975082 29267 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } }
I20260812 07:03:22.975935 29275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } } }
I20260812 07:03:22.976320 29275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:22.976766 29267 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [sys.catalog]: configured and running, proceeding with master startup.
W20260812 07:03:22.985621 29306 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 07:03:22.985759 29306 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 07:03:22.983276 29136 master_runner.cc:186] Error getting master registration for 127.18.70.190:43477: OK, instance_id { permanent_uuid: "a41f7a38626242028d62738c255e659c" instance_seqno: 1786518201889947 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 07:03:22.994071 29136 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 07:03:23.023082 28985 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } attempt: 4
Aug 12 07:03:23 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518201, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.190@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
I20260812 07:03:23.037768 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.023741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:44072)
0812 07:03:23.023947 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:23.023968 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:23.024100 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:23.024453 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:23.024459 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:23.024852 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:23.025024 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:23.025033 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.026179 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.026184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:23.027151 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:23.027163 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.027885 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.027890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:23.028097 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.028694 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:23.028711 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:23.031015 (+ 2304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:23.035015 (+ 4000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:23.035021 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:23.035026 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:23.035529 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:23.035920 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:23.035925 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:23.035929 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:23.036093 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:23.036764 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:23.036769 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:23.036952 (+ 183us) client_negotiation.cc:769] Sending connection context
0812 07:03:23.037097 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 07:03:23.037371 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 07:03:23.037842 29270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.023783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44072 (local address 127.18.70.188:33305)
0812 07:03:23.023997 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.024006 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.024027 (+ 21us) server_negotiation.cc:407] Connection header received
0812 07:03:23.024227 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.024233 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.024302 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.024383 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.025176 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.026032 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.027291 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.027745 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.027854 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.031211 (+ 3357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:23.031218 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:23.031223 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:23.031263 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:23.034877 (+ 3614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:23.035649 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:23.035655 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:23.035659 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:23.035800 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:23.036197 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:23.036202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:23.036205 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:23.036635 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:23.036800 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.037232 (+ 432us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.037464 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 07:03:23.042536 28985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c: Bootstrap starting.
I20260812 07:03:23.046396 28985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:23.047662 28985 log.cc:824] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:23.050521 28985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c: No bootstrap required, opened a new log
I20260812 07:03:23.056114 28985 raft_consensus.cc:348] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } }
I20260812 07:03:23.056481 28985 raft_consensus.cc:729] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a41f7a38626242028d62738c255e659c, State: Initialized, Role: FOLLOWER
I20260812 07:03:23.056959 28985 consensus_queue.cc:260] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } }
I20260812 07:03:23.058135 29314 sys_catalog.cc:455] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } } }
I20260812 07:03:23.058734 29314 sys_catalog.cc:458] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:23.059233 28985 sys_catalog.cc:564] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:23.059342 28934 raft_consensus.cc:482] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 07:03:23.059532 28934 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:23.062980 28934 raft_consensus.cc:504] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } }
I20260812 07:03:23.064471 28934 leader_election.cc:288] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [CANDIDATE]: Term 1 election: Requested vote from peers 0c7d1d8668ea41a1ba8ade84c6b93eac (127.18.70.189:38227), 43fb50b7805643c6a9d3e3ea72f2bf9c (127.18.70.188:33305)
I20260812 07:03:23.065932 29220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a41f7a38626242028d62738c255e659c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c"
I20260812 07:03:23.066445 29220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:23.070096 29220 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a41f7a38626242028d62738c255e659c in term 1.
I20260812 07:03:23.070782 28891 leader_election.cc:302] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43fb50b7805643c6a9d3e3ea72f2bf9c, a41f7a38626242028d62738c255e659c; no voters:
I20260812 07:03:23.071312 29314 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 07:03:23.071974 29314 raft_consensus.cc:686] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [term 1 LEADER]: Becoming Leader. State: Replica: a41f7a38626242028d62738c255e659c, State: Running, Role: LEADER
I20260812 07:03:23.072566 29314 consensus_queue.cc:237] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } }
I20260812 07:03:23.076010 29323 sys_catalog.cc:455] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a41f7a38626242028d62738c255e659c. Latest consensus state: current_term: 1 leader_uuid: "a41f7a38626242028d62738c255e659c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } } }
I20260812 07:03:23.076380 29323 sys_catalog.cc:458] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:23.077699 29326 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 07:03:23.086678 29326 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 07:03:23.104764 29121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } attempt: 5
I20260812 07:03:23.110028 29220 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [term 1 FOLLOWER]: Refusing update from remote peer a41f7a38626242028d62738c255e659c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:03:23.111172 29314 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [LEADER]: Connected to new peer: Peer: permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:03:23.121336 29275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a41f7a38626242028d62738c255e659c. Latest consensus state: current_term: 1 leader_uuid: "a41f7a38626242028d62738c255e659c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } } }
I20260812 07:03:23.121649 29275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [sys.catalog]: This master's current role is: FOLLOWER
W20260812 07:03:23.130419 28895 tablet.cc:2369] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 07:03:23.131263 29183 tablet.cc:2369] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 07:03:23.135664 29349 mvcc.cc:205] Tried to move back new op lower bound from 7317578559925469184 to 7317578559790354432. Current Snapshot: MvccSnapshot[applied={T|T < 7317578559925469184}]
I20260812 07:03:23.135759 29360 mvcc.cc:205] Tried to move back new op lower bound from 7317578559925469184 to 7317578559790354432. Current Snapshot: MvccSnapshot[applied={T|T < 7317578559925469184}]
I20260812 07:03:23.137369 29275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a41f7a38626242028d62738c255e659c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } } }
I20260812 07:03:23.140547 29314 sys_catalog.cc:455] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a41f7a38626242028d62738c255e659c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } } }
I20260812 07:03:23.140872 29314 sys_catalog.cc:458] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [sys.catalog]: This master's current role is: LEADER
I20260812 07:03:23.141330 29275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c [sys.catalog]: This master's current role is: FOLLOWER
Aug 12 07:03:23 dist-test-slave-tc2s krb5kdc[28832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786518202, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.70.189@KRBTEST.COM for kudu/127.18.70.188@KRBTEST.COM
I20260812 07:03:23.151337 29326 catalog_manager.cc:1347] Generated new cluster ID: f999e343f37f4051b0f33e8bd799190d
I20260812 07:03:23.151440 29326 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 07:03:23.174268 29326 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 07:03:23.175812 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.097549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42642 (local address 127.18.70.189:38227)
0812 07:03:23.097731 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.097737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.104065 (+ 6328us) server_negotiation.cc:407] Connection header received
0812 07:03:23.122748 (+ 18683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.122754 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.122839 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.122926 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.127789 (+ 4863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.128881 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.139803 (+ 10922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.140482 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.140584 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.145690 (+ 5106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:23.145697 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:23.145703 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:23.145743 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:23.153352 (+ 7609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:23.164481 (+ 11129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:23.164489 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:23.164493 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:23.164667 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:23.167109 (+ 2442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:23.167115 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:23.167118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:23.167482 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:23.167738 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.175136 (+ 7398us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.175398 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 07:03:23.177623 29326 catalog_manager.cc:1504] Loading token signing keys...
I20260812 07:03:23.193694 28992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.096522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33030 (local address 127.18.70.190:43477)
0812 07:03:23.096704 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.096710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.103127 (+ 6417us) server_negotiation.cc:407] Connection header received
0812 07:03:23.105102 (+ 1975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.105108 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.105192 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.105266 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.130018 (+ 24752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.131150 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.137935 (+ 6785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.138702 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.138816 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.170665 (+ 31849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:23.170673 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:23.170679 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:23.170730 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:23.174705 (+ 3975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:23.182236 (+ 7531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:23.182243 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:23.182247 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:23.182441 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:23.185043 (+ 2602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:23.185050 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:23.185054 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:23.185439 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:23.185695 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.192963 (+ 7268us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.193274 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 07:03:23.196650 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.105272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.70.188:33305 (local address 127.0.0.1:44080)
0812 07:03:23.105500 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 07:03:23.105516 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 07:03:23.105614 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 07:03:23.124146 (+ 18532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 07:03:23.124153 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 07:03:23.124651 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0812 07:03:23.124846 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:23.124860 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.134438 (+ 9578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.134443 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:23.135865 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 07:03:23.135882 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.146049 (+ 10167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.146057 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 07:03:23.146314 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.147026 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 07:03:23.147050 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 07:03:23.151517 (+ 4467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 07:03:23.183329 (+ 31812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:23.183335 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:23.183338 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:23.183893 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:23.186845 (+ 2952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 07:03:23.186851 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 07:03:23.186855 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 07:03:23.187028 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 07:03:23.195595 (+ 8567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 07:03:23.195601 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 07:03:23.195774 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 07:03:23.195929 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 07:03:23.196238 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126}
I20260812 07:03:23.203800 29270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.100801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44078 (local address 127.18.70.188:33305)
0812 07:03:23.100983 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.100990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.125421 (+ 24431us) server_negotiation.cc:407] Connection header received
0812 07:03:23.125664 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.125669 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.125739 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.125804 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.132943 (+ 7139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.133980 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.141516 (+ 7536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.142164 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.142263 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.187672 (+ 45409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:23.187678 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:23.187683 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:23.187721 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:23.191462 (+ 3741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:23.199408 (+ 7946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:23.199415 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:23.199419 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:23.199556 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:23.200852 (+ 1296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:23.200858 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:23.200862 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:23.201200 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:23.201439 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.203134 (+ 1695us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.203367 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 07:03:23.204293 29358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.105542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44080 (local address 127.18.70.188:33305)
0812 07:03:23.123065 (+ 17523us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.123078 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.123101 (+ 23us) server_negotiation.cc:407] Connection header received
0812 07:03:23.123359 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.123365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.123747 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.125188 (+ 1441us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.126478 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.134071 (+ 7593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.136602 (+ 2531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.142767 (+ 6165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.146637 (+ 3870us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.153695 (+ 7058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 07:03:23.153704 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 07:03:23.153709 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 07:03:23.153782 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0812 07:03:23.182849 (+ 29067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:23.184307 (+ 1458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:23.184471 (+ 164us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:23.184483 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:23.186471 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 07:03:23.187517 (+ 1046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 07:03:23.187522 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 07:03:23.187526 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 07:03:23.195110 (+ 7584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 07:03:23.198712 (+ 3602us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.199668 (+ 956us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.200726 (+ 1058us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17015,"thread_start_us":17012,"threads_started":1}
I20260812 07:03:23.210919 29121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac: Bootstrap starting.
I20260812 07:03:23.211526 29326 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c: Generated new TSK 0
I20260812 07:03:23.212482 29326 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 07:03:23.220873 29121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac: Neither blocks nor log segments found. Creating new log.
I20260812 07:03:23.226487 29121 log.cc:824] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac: Log is configured to *not* fsync() on all Append() calls
I20260812 07:03:23.231760 29121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac: No bootstrap required, opened a new log
I20260812 07:03:23.244858 29121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } }
I20260812 07:03:23.245328 29121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7d1d8668ea41a1ba8ade84c6b93eac, State: Initialized, Role: FOLLOWER
I20260812 07:03:23.245878 29121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } }
I20260812 07:03:23.250195 29375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } } }
I20260812 07:03:23.253077 29375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:23.252962 29121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [sys.catalog]: configured and running, proceeding with master startup.
I20260812 07:03:23.253192 29077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a41f7a38626242028d62738c255e659c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac"
I20260812 07:03:23.253662 29077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [term 0 FOLLOWER]: Advancing to term 1
I20260812 07:03:23.255700 29377 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 07:03:23.258342 29077 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a41f7a38626242028d62738c255e659c in term 1.
I20260812 07:03:23.259301 29075 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [term 1 FOLLOWER]: Refusing update from remote peer a41f7a38626242028d62738c255e659c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 07:03:23.260964 29323 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 07:03:23.267490 28855 master_runner.cc:186] Error getting master registration for 127.18.70.189:38227: OK, instance_id { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" instance_seqno: 1786518202387525 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 07:03:23.281626 28855 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 07:03:23.343480 29392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a41f7a38626242028d62738c255e659c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } } }
I20260812 07:03:23.343937 29392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:23.344602 29375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [sys.catalog]: SysCatalogTable state changed. Reason: New leader a41f7a38626242028d62738c255e659c. Latest consensus state: current_term: 1 leader_uuid: "a41f7a38626242028d62738c255e659c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } } }
I20260812 07:03:23.344893 29375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 07:03:23.376850 29413 catalog_manager.cc:1259] Loaded cluster ID: f999e343f37f4051b0f33e8bd799190d
I20260812 07:03:23.376958 29413 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac: loading cluster ID for follower catalog manager: success
I20260812 07:03:23.380774 29413 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac: acquiring CA information for follower catalog manager: success
I20260812 07:03:23.384099 29413 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0c7d1d8668ea41a1ba8ade84c6b93eac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 07:03:23.394111 18714 mini_kdc.cc:348] Time spent kdestroy: real 0.125s user 0.000s sys 0.030s
W20260812 07:03:23.458685 28992 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:23.455438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33046 (local address 127.18.70.190:43477)
0812 07:03:23.455700 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.455707 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.456513 (+ 806us) server_negotiation.cc:407] Connection header received
0812 07:03:23.456826 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.456834 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.456932 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.457015 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.458390 (+ 1375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33046: BlockingRecv error: recv got EOF from 127.0.0.1:33046 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260812 07:03:23.462263 29130 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:23.456242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42650 (local address 127.18.70.189:38227)
0812 07:03:23.456417 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.456423 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.460171 (+ 3748us) server_negotiation.cc:407] Connection header received
0812 07:03:23.460430 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.460435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.460543 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.460624 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.462017 (+ 1393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42650: BlockingRecv error: recv got EOF from 127.0.0.1:42650 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260812 07:03:23.464583 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:23.460848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44086 (local address 127.18.70.188:33305)
0812 07:03:23.461036 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.461043 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.463008 (+ 1965us) server_negotiation.cc:407] Connection header received
0812 07:03:23.463240 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.463246 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.463347 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.463414 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.464327 (+ 913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44086: BlockingRecv error: recv got EOF from 127.0.0.1:44086 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 07:03:23.531545 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.516084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42666 (local address 127.18.70.189:38227)
0812 07:03:23.516293 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.516299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.523597 (+ 7298us) server_negotiation.cc:407] Connection header received
0812 07:03:23.524139 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.524146 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.524378 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.524506 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:23.525230 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.526441 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.528496 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.529182 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.529285 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.530067 (+ 782us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:23.530702 (+ 635us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:23.530824 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.531072 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.531178 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260812 07:03:23.574363 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:23.565271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44100 (local address 127.18.70.188:33305)
0812 07:03:23.565462 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.565468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.572247 (+ 6779us) server_negotiation.cc:407] Connection header received
0812 07:03:23.572755 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.572762 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.572890 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.572978 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.574098 (+ 1120us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44100: BlockingRecv error: recv got EOF from 127.0.0.1:44100 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 07:03:23.602226 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.595163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42680 (local address 127.18.70.189:38227)
0812 07:03:23.595338 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.595345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.595864 (+ 519us) server_negotiation.cc:407] Connection header received
0812 07:03:23.596087 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.596093 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.596257 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.596370 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:23.596854 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.598068 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.600070 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.600764 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.600905 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.601373 (+ 468us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:23.601536 (+ 163us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:23.601635 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.601792 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.601879 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 07:03:23.611272 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:23.609031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44106 (local address 127.18.70.188:33305)
0812 07:03:23.609214 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.609220 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.609829 (+ 609us) server_negotiation.cc:407] Connection header received
0812 07:03:23.610020 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.610027 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.610117 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.610217 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.611061 (+ 844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44106: BlockingRecv error: recv got EOF from 127.0.0.1:44106 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 07:03:23.623442 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.616994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42684 (local address 127.18.70.189:38227)
0812 07:03:23.617166 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.617172 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.617303 (+ 131us) server_negotiation.cc:407] Connection header received
0812 07:03:23.617575 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.617581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.617662 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.617753 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:23.618217 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.619355 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.621290 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.622029 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.622150 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.622639 (+ 489us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:23.622770 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:23.622861 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.623030 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.623115 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260812 07:03:23.636109 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:23.633816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44110 (local address 127.18.70.188:33305)
0812 07:03:23.634029 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.634034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.634584 (+ 550us) server_negotiation.cc:407] Connection header received
0812 07:03:23.634766 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.634771 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.634877 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.634980 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.635866 (+ 886us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44110: BlockingRecv error: recv got EOF from 127.0.0.1:44110 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 07:03:23.650816 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.643964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42700 (local address 127.18.70.189:38227)
0812 07:03:23.644150 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.644156 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.644709 (+ 553us) server_negotiation.cc:407] Connection header received
0812 07:03:23.644904 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.644910 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.645014 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.645102 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:23.645659 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.646809 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.648748 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.649466 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.649591 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.650083 (+ 492us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:23.650210 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:23.650297 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.650464 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.650549 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260812 07:03:23.660718 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:23.658520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44120 (local address 127.18.70.188:33305)
0812 07:03:23.658833 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.658839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.659311 (+ 472us) server_negotiation.cc:407] Connection header received
0812 07:03:23.659475 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.659481 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.659565 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.659658 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.660481 (+ 823us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44120: BlockingRecv error: recv got EOF from 127.0.0.1:44120 (error 108)
Metrics: {"server-negotiator.queue_time_us":169}
I20260812 07:03:23.679807 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.672963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42704 (local address 127.18.70.189:38227)
0812 07:03:23.673158 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.673164 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.673640 (+ 476us) server_negotiation.cc:407] Connection header received
0812 07:03:23.673809 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.673818 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.673939 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.674045 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:23.674449 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.675582 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.677479 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.678269 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.678397 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.678867 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:23.679025 (+ 158us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:23.679118 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.679382 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.679462 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 07:03:23.689497 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:23.687219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44122 (local address 127.18.70.188:33305)
0812 07:03:23.687400 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.687406 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.687896 (+ 490us) server_negotiation.cc:407] Connection header received
0812 07:03:23.688110 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.688116 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.688212 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.688280 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.689252 (+ 972us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44122: BlockingRecv error: recv got EOF from 127.0.0.1:44122 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 07:03:23.717365 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.710865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42708 (local address 127.18.70.189:38227)
0812 07:03:23.711056 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.711062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.711577 (+ 515us) server_negotiation.cc:407] Connection header received
0812 07:03:23.711759 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.711765 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.711873 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.711986 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:23.712436 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.713684 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.715073 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.715757 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.715904 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.716537 (+ 633us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:23.716681 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:23.716733 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.716978 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.717075 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 07:03:23.717244 29323 sys_catalog.cc:455] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a41f7a38626242028d62738c255e659c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a41f7a38626242028d62738c255e659c" member_type: VOTER last_known_addr { host: "127.18.70.190" port: 43477 } } peers { permanent_uuid: "0c7d1d8668ea41a1ba8ade84c6b93eac" member_type: VOTER last_known_addr { host: "127.18.70.189" port: 38227 } } peers { permanent_uuid: "43fb50b7805643c6a9d3e3ea72f2bf9c" member_type: VOTER last_known_addr { host: "127.18.70.188" port: 33305 } } }
I20260812 07:03:23.717542 29323 sys_catalog.cc:458] T 00000000000000000000000000000000 P a41f7a38626242028d62738c255e659c [sys.catalog]: This master's current role is: LEADER
W20260812 07:03:23.729800 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:23.723709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44128 (local address 127.18.70.188:33305)
0812 07:03:23.723862 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.723867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.728484 (+ 4617us) server_negotiation.cc:407] Connection header received
0812 07:03:23.728638 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.728644 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.728718 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.728795 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.729577 (+ 782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44128: BlockingRecv error: recv got EOF from 127.0.0.1:44128 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 07:03:23.771123 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.765490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42716 (local address 127.18.70.189:38227)
0812 07:03:23.765706 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.765712 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.765975 (+ 263us) server_negotiation.cc:407] Connection header received
0812 07:03:23.766166 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.766172 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.766270 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.766389 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:23.766722 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.767844 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.769131 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.769847 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.770035 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.770363 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:23.770493 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:23.770607 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.770696 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.770773 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260812 07:03:23.778888 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:23.776934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44136 (local address 127.18.70.188:33305)
0812 07:03:23.777148 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.777154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.777408 (+ 254us) server_negotiation.cc:407] Connection header received
0812 07:03:23.777606 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.777610 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.777692 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.777771 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.778672 (+ 901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44136: BlockingRecv error: recv got EOF from 127.0.0.1:44136 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
I20260812 07:03:23.851120 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.846601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42720 (local address 127.18.70.189:38227)
0812 07:03:23.846763 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.846767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.847129 (+ 362us) server_negotiation.cc:407] Connection header received
0812 07:03:23.847289 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.847294 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.847364 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.847447 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:23.847800 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.848515 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.849755 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.850176 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.850266 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.850613 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:23.850708 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:23.850766 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.850855 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.850914 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 07:03:23.858304 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 07:03:23.856703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44138 (local address 127.18.70.188:33305)
0812 07:03:23.856902 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.856908 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.857128 (+ 220us) server_negotiation.cc:407] Connection header received
0812 07:03:23.857270 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.857274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.857346 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.857425 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 07:03:23.858076 (+ 651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44138: BlockingRecv error: recv got EOF from 127.0.0.1:44138 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 07:03:23.988140 29306 catalog_manager.cc:1259] Loaded cluster ID: f999e343f37f4051b0f33e8bd799190d
I20260812 07:03:23.988274 29306 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c: loading cluster ID for follower catalog manager: success
I20260812 07:03:23.991834 29306 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c: acquiring CA information for follower catalog manager: success
I20260812 07:03:23.993975 29306 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 43fb50b7805643c6a9d3e3ea72f2bf9c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 07:03:23.996354 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:23.991226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42734 (local address 127.18.70.189:38227)
0812 07:03:23.991434 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:23.991440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:23.991763 (+ 323us) server_negotiation.cc:407] Connection header received
0812 07:03:23.991990 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:23.991996 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:23.992070 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:23.992146 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:23.992630 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.993282 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.994798 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:23.995189 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:23.995277 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:23.995657 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:23.995753 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:23.995813 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:23.996008 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 07:03:23.996073 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 07:03:24.007331 29358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:24.001836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44140 (local address 127.18.70.188:33305)
0812 07:03:24.002054 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:24.002060 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:24.002354 (+ 294us) server_negotiation.cc:407] Connection header received
0812 07:03:24.002523 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:24.002527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:24.002656 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:24.002749 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:24.003129 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:24.003844 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:24.005168 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:24.005622 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:24.005731 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:24.006258 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:24.006765 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:24.006896 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:24.006998 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 07:03:24.007079 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 07:03:24.027247 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:24.013041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42748 (local address 127.18.70.189:38227)
0812 07:03:24.013234 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:24.013239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:24.020541 (+ 7302us) server_negotiation.cc:407] Connection header received
0812 07:03:24.021026 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:24.021037 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:24.021148 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:24.021212 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:24.022057 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:24.022984 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:24.025100 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:24.025751 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:24.025936 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:24.026399 (+ 463us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:24.026555 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:24.026615 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:24.026870 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 07:03:24.026969 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 07:03:24.028188 29358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:24.013145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44144 (local address 127.18.70.188:33305)
0812 07:03:24.013295 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:24.013301 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:24.022282 (+ 8981us) server_negotiation.cc:407] Connection header received
0812 07:03:24.022444 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:24.022450 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:24.022531 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:24.022614 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:24.023276 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:24.024016 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:24.026102 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:24.026499 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:24.026605 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:24.027112 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:24.027260 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:24.027323 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:24.027838 (+ 515us) server_negotiation.cc:299] Negotiation successful
0812 07:03:24.027926 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 07:03:24.028878 29643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 07:03:24.013178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33050 (local address 127.18.70.190:43477)
0812 07:03:24.021809 (+ 8631us) server_negotiation.cc:206] Beginning negotiation
0812 07:03:24.021815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 07:03:24.021837 (+ 22us) server_negotiation.cc:407] Connection header received
0812 07:03:24.022005 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 07:03:24.022011 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 07:03:24.022255 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 07:03:24.022483 (+ 228us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 07:03:24.023103 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:24.024243 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:24.026147 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 07:03:24.026770 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 07:03:24.027305 (+ 535us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 07:03:24.027502 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 07:03:24.027967 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 07:03:24.028444 (+ 477us) server_negotiation.cc:1035] Waiting for connection context
0812 07:03:24.028496 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 07:03:24.028580 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8499,"thread_start_us":8396,"threads_started":1}
I20260812 07:03:24.033010 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 28855
I20260812 07:03:24.034092 28973 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:03:24.146000 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 28855
I20260812 07:03:24.176307 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 28999
I20260812 07:03:24.177429 29110 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:03:24.286331 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 28999
I20260812 07:03:24.311482 18714 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu pid 29136
I20260812 07:03:24.312621 29258 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 07:03:24.426471 18714 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGv53JZ/build/asan/bin/kudu with pid 29136
2026-08-12T07:03:24Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4532 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9490 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (372193 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST